-- Logs begin at Wed 2022-05-11 09:10:27 UTC, end at Wed 2022-05-11 10:13:14 UTC. -- May 11 09:42:38.950264 dv-cinder-836996-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 09:42:38.958995 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 09:42:38 2022] *** May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: nodename: dv-cinder-836996-21-iscsi May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: machine: x86_64 May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: clock source: unix May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: pcre jit disabled May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: detected number of CPU cores: 4 May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: current working directory: / May 11 09:42:38.960989 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: detected binary path: /usr/bin/uwsgi-core May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: your processes number limit is 47680 May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: your memory page size is 4096 bytes May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: detected max file descriptor number: 2048 May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: lock engine: pthread robust mutexes May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: thunder lock: enabled May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 09:42:38.961666 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 09:42:39.005713 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: Python main interpreter initialized at 0x562af67c79c0 May 11 09:42:39.005713 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: python threads support enabled May 11 09:42:39.005713 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: your server socket listen backlog is limited to 100 connections May 11 09:42:39.005713 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: your mercy for graceful operations on workers is 90 seconds May 11 09:42:39.006030 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: mapped 403077 bytes (393 KB) for 2 cores May 11 09:42:39.006106 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: *** Operational MODE: preforking *** May 11 09:42:39.006364 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: *** uWSGI is running in multiple interpreter mode *** May 11 09:42:39.006364 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: spawned uWSGI master process (pid: 109014) May 11 09:42:39.006534 dv-cinder-836996-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 09:42:39.007076 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: spawned uWSGI worker 1 (pid: 109015, cores: 1) May 11 09:42:39.007779 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: spawned uWSGI worker 2 (pid: 109016, cores: 1) May 11 09:42:39.007779 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 09:42:40.194789 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 09:42:40.195423 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 09:42:40.922970 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:42:40.922970 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: from cryptography.utils import int_from_bytes May 11 09:42:40.923296 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:42:40.923296 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: from cryptography.utils import int_from_bytes May 11 09:42:40.923513 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:42:40.923513 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: from cryptography.utils import int_from_bytes May 11 09:42:40.923811 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:42:40.923811 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: from cryptography.utils import int_from_bytes May 11 09:42:43.502857 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 09:42:43.503525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 09:42:43.503628 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 09:42:43.503628 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 09:42:43.504081 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 09:42:43.504081 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 09:42:43.504242 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 09:42:43.504327 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 09:42:43.504436 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 09:42:43.504526 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.504609 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 09:42:43.504843 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505001 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505165 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505284 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505480 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505577 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505806 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.505907 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506114 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506208 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506431 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506524 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506748 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.506840 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507074 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507166 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507334 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507426 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507646 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.507991 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508083 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-21-iscsi {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508311 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508402 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-21-iscsi {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508629 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508773 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.508923 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509053 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509226 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509361 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509524 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509680 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509843 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.509974 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.510143 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.510285 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.510460 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.510635 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.510964 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511103 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511278 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511410 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511586 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511733 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.511925 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.512073 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.512307 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.512459 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.512671 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.512864 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.513055 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.513246 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.513452 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.513636 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.513828 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514019 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514213 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514413 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514606 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514792 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-21-iscsi {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.514996 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-21-iscsi {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.515182 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.515383 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.515576 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.515776 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.515996 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.516192 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.516342 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.516342 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.516723 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.516880 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517045 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517194 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517325 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517457 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517619 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517745 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.517873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518125 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518125 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518409 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518533 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518655 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518785 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.518908 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519045 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519180 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519308 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519436 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519565 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519753 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.519890 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520020 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520020 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520267 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520390 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520526 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520526 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520844 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.520844 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521086 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521216 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521338 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521469 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521602 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.521726 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522107 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522107 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522439 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522577 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522712 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522843 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.522972 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523105 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523238 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523373 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523507 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523641 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523805 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.523951 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524082 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524214 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524338 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524460 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524592 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524723 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524852 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.524981 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525109 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525241 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525377 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525513 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525643 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525776 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.525908 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526099 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526243 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526406 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526541 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526725 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.526858 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527089 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527223 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527355 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527478 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527646 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.527803 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528009 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528149 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528325 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528452 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528630 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528763 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.528943 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529084 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529265 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529401 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529570 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529696 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.529874 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530010 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530177 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530314 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530481 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530608 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530798 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.530930 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531099 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531234 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531368 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531498 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531632 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531799 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.531936 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532060 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532250 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532384 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532590 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532724 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.532896 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533022 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533201 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533337 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533499 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533631 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533798 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.533932 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534099 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534301 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534433 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534566 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534689 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534813 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.534980 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535116 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535282 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535409 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535584 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535730 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.535909 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536049 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536214 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536347 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536518 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536643 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536835 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.536967 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537140 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537268 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537445 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537571 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537748 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.537882 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538053 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538178 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538362 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538490 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538664 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538798 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.538968 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539102 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539272 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539396 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539578 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539744 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.539907 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540035 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540214 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540338 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540518 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540645 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540824 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.540949 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541128 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541253 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541425 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541552 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541729 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.541861 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542034 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542160 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542334 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542460 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542638 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.542942 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543067 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543245 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543380 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543545 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543671 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.543873 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544013 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544176 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544304 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544480 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544603 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544766 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.544899 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545076 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545201 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545393 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545523 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545700 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545870 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.545996 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546124 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546294 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546428 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546606 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546741 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.546927 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:42:43.547055 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.547253 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.547378 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.547585 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.547766 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.547919 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.548079 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.548779 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.548905 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549107 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549233 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549427 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549555 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549737 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.549871 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550050 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550176 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550368 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550495 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550676 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550816 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.550986 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551112 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551295 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551421 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551606 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551768 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.551946 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552078 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552297 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552482 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552620 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552743 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552874 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.552998 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553173 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553300 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553482 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553619 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553797 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.553923 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554115 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554247 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554431 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554574 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554739 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.554873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555058 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555193 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555401 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555609 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555756 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.555879 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556042 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556177 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556361 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556497 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556672 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556802 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.556983 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557110 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557292 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557421 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557612 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557743 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.557937 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558072 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558245 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558381 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558568 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558696 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.558877 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559005 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559186 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559314 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559494 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559621 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559824 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.559955 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560135 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560268 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560447 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560573 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560765 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.560899 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561078 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561206 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561386 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561520 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561698 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.561837 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562004 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562130 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562312 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562446 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562620 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562755 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.562921 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.563047 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.563222 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.563349 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.563523 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.563660 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.564452 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.564583 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.564717 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.564848 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565005 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565228 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565356 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565478 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565621 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565750 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.565939 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566064 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566237 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566362 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566545 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566671 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566853 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.566981 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567162 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567290 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567465 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567591 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567796 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.567938 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568105 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568232 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568408 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568534 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568714 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.568839 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569030 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569162 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569336 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569471 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569642 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569766 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.569947 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570072 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570249 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570378 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570557 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570671 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570861 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.570986 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571169 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571304 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571476 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571613 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571805 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.571933 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572118 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572255 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572424 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572560 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572733 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.572858 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573048 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573173 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573378 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573514 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573680 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.573814 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574002 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574128 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574322 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574453 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574634 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574761 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.574935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575062 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575243 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575386 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575544 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575679 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575868 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.575996 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576171 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576304 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576474 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576608 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576770 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.576895 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577068 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577194 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577369 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577506 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577670 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577798 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.577969 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578095 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578272 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578406 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578582 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578707 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.578883 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579015 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579183 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579318 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579506 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579641 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579841 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.579979 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580160 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580286 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580480 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580604 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580813 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.580946 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581127 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581255 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581446 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581572 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581754 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.581881 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582070 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582203 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582375 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582507 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582683 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582810 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.582990 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583125 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583297 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583424 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583609 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583766 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.583938 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584064 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584253 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584386 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584562 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584760 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.584886 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585012 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585175 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585307 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585486 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585620 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585786 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.585911 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586099 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586225 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586416 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586553 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586756 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.586880 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587071 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587204 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587390 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587518 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587744 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.587875 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588029 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588156 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588337 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588475 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588648 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588772 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.588953 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589078 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589262 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589389 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589575 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589701 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.589882 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590009 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590192 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590317 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590497 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590622 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590810 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.590933 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591114 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591240 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591428 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591554 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591747 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.591897 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592059 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592184 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592373 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592700 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.592833 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593009 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593136 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593319 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593446 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593630 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593764 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.593936 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594062 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594244 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594370 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594552 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594692 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594856 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.594983 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595181 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595307 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595490 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595626 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595824 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.595952 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596131 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596263 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596439 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596573 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596739 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.596866 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597050 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597178 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597354 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597483 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597654 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597781 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.597954 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598088 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598261 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598573 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598704 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.598875 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599009 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599192 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599318 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599508 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599634 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.599968 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600130 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600270 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600439 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600571 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600743 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.600880 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601043 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601176 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601344 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601470 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601645 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601781 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.601948 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602073 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602275 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602409 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602575 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602702 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.602880 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603007 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603193 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603320 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603500 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603628 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603833 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.603960 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604141 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604268 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604447 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604576 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604757 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.604889 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605066 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605191 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605370 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605498 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605676 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605803 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.605983 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606110 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606288 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606424 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606593 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606733 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.606905 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607046 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607207 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607340 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607514 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607648 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607843 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.607983 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608145 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608280 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608457 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608769 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.608909 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.609092 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.609331 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.609656 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.609784 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.609967 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.610094 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.610284 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.610412 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611116 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611257 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611436 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611565 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611782 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.611912 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612106 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612239 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612434 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612560 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612738 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.612873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613047 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613184 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613350 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613480 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613651 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613786 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.613955 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614080 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614256 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614381 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614559 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614686 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614860 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.614987 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615164 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615297 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615464 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615592 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615786 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.615915 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616088 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616215 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616390 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616518 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616702 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.616829 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617006 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617133 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617314 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617442 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617615 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617751 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.617932 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618070 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618235 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618367 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618663 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618837 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.618976 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619142 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619268 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619448 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619575 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619791 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.619931 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.620126 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.620410 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.620549 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.620765 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.620906 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621067 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621193 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621370 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621504 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621691 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621835 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.621994 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622121 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622293 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622421 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622592 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622728 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.622898 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623025 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623205 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623339 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623503 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623644 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.623959 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.624137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.624291 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.624469 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.624749 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.625065 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.625375 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.625681 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.625994 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.626839 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.627181 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.627326 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.627497 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.627835 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.628264 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.628415 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.628596 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.628723 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.628930 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629056 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629251 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629384 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629565 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629699 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.629998 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630184 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630318 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630491 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630624 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630797 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.630924 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631102 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631229 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631408 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631540 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631738 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.631877 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632049 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632184 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632372 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632498 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632679 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632812 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.632984 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633109 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633286 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633413 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633593 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633731 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.633899 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634025 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634201 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634333 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634510 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634645 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634820 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.634957 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635123 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635250 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635427 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635563 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635741 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.635867 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636048 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636352 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636494 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636658 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636784 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.636966 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637090 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637270 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637397 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637570 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637705 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.637878 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638004 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638177 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638310 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638481 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638607 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638779 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.638905 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639084 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639211 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639384 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639511 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639683 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.639828 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640003 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640135 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640295 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640423 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640595 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.640914 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641042 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641219 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641353 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641520 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641661 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.641839 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642014 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642173 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642300 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642513 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642646 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642813 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.642940 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643124 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643248 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643439 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643574 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643776 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.643906 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644095 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644219 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644400 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644538 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644707 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.644835 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645020 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645146 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645533 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645721 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645835 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.645961 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646083 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646213 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646348 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646472 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646594 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.646965 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647085 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647211 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647408 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647533 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647663 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647809 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.647980 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648108 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648304 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648432 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648620 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648752 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.648932 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649068 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649234 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649359 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649543 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649667 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649852 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.649986 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650161 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650288 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650467 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650598 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650772 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.650905 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651080 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651213 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651387 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651514 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651712 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.651853 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652032 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652159 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652337 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652477 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652648 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652775 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.652933 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653060 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653244 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653381 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653513 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653639 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653851 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.653986 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654160 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654287 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654461 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654597 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654768 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.654889 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655071 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655204 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655379 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655508 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655681 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.655837 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656075 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656217 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656382 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656509 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656718 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.656843 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.657023 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.657159 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.657332 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.657956 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658172 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658298 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658489 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658629 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658800 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.658926 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659102 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659229 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659434 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659569 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.659892 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660075 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660201 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660381 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660516 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660706 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.660840 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661014 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661148 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661321 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661448 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661645 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661773 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.661949 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662083 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662253 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662390 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662561 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662728 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.662880 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663042 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663179 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663356 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663489 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663679 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.663922 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664063 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664234 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664361 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664537 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664664 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.664927 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665061 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665252 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665383 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665540 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665666 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.665878 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666015 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666165 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666305 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666480 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666612 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666782 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.666910 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667094 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667229 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667400 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667527 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667741 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.667872 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668068 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668206 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668374 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668500 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668686 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668813 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.668987 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669116 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669305 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669432 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669631 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669760 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.669943 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670072 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670264 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670393 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670605 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670729 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.670913 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671048 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671220 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671354 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671544 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671672 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.671877 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672007 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672192 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672320 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672500 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672639 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672810 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.672934 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.673151 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.673766 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.673947 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674085 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674268 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674397 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674572 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674706 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.674882 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675018 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675190 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675331 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675496 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675624 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675820 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.675974 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676121 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676249 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676438 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676565 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676739 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.676867 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677048 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677174 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677357 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677484 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677666 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677795 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.677982 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678107 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678284 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678411 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678601 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678730 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.678907 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679036 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679210 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679337 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679510 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679640 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679835 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.679971 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680173 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680378 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680504 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680627 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680779 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.680906 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681105 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681250 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681431 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681559 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681740 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.681861 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682070 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682210 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682390 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682516 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682701 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.682835 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683008 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683144 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683318 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683452 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683618 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683782 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.683942 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684083 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684246 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684381 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684546 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684672 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684849 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.684978 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685150 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685278 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685457 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685584 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685756 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.685885 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686055 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686190 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686354 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686494 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686672 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686801 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.686971 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687106 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687307 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687445 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687627 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687774 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.687957 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688093 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688260 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688397 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688561 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688721 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.688924 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689053 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689225 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689362 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689553 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689678 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689866 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.689992 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690180 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690315 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690498 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690634 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690819 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.690945 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691151 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691279 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691463 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691588 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691803 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.691941 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692122 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692250 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692433 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692558 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692747 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.692957 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693093 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693296 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693423 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693619 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693745 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.693940 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694075 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694259 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694393 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694573 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694699 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.694888 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695094 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695222 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695421 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695547 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695756 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.695905 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696067 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696195 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696378 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696512 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696823 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.696998 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697133 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697308 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697436 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697615 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697750 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.697920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698048 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698225 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698353 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698552 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698680 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.698873 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699009 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699196 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699333 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699529 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699656 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699870 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.699998 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700183 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700323 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700495 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700623 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700808 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.700933 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701122 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701258 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701440 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701568 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701748 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.701873 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702060 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702187 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702370 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702503 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702681 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702808 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.702990 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703118 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703298 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703426 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703608 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703781 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.703943 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704080 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704253 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704422 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704621 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704759 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.704934 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705069 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705247 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705451 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705578 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705768 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.705918 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706103 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706230 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706563 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706754 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.706883 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707070 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707197 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707385 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707639 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707786 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.707977 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708106 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708308 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708436 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708626 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708753 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.708936 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709063 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709241 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709368 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709616 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709743 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709866 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.709990 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710150 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710278 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710454 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710582 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710762 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.710889 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711068 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711294 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711422 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711644 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711799 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.711992 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712114 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712292 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712390 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712610 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712715 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.712918 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713013 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713236 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713448 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713544 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713793 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.713889 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714110 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714214 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714432 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714526 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714749 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.714849 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715056 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715151 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715358 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715467 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715668 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715798 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.715995 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716090 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716297 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716390 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716606 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716700 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.716911 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717014 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717210 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717303 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717508 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717603 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717817 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.717913 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718121 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718214 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718420 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718522 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718727 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.718821 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719028 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719122 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719334 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719436 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719641 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.719769 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.720486 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.720579 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.720797 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.720964 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721107 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721251 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721388 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721533 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721676 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721821 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.721957 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722105 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722260 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722390 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722564 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722712 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722855 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.722993 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723160 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723296 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723462 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723601 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723795 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.723932 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724098 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724236 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724408 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724546 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724754 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.724892 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725073 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725215 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725360 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725493 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725665 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725801 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.725982 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.726248 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.726379 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.726584 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.726713 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.726897 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727030 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727208 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727344 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727551 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727679 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.727888 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728024 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728200 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728420 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728555 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728750 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.728878 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729069 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729314 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729446 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729577 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729709 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.729835 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730014 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730143 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730318 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730446 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730623 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730750 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.730931 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731057 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731239 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731366 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731548 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731674 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.731877 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732006 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732190 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732317 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732499 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732635 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732804 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.732942 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733111 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733244 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733418 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733553 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733727 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.733854 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734031 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734164 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734338 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734477 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734642 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734769 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.734951 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.735079 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.735259 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.735385 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.735586 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.736230 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.736448 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.736575 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.736781 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.736911 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737095 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737229 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737403 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737528 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737706 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.737833 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738013 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738141 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738318 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738452 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738629 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738756 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.738953 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739080 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739264 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739466 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739593 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739735 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.739990 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740118 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740302 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740443 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740619 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740743 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.740936 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741054 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741247 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741377 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741566 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741692 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.741889 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742016 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742200 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742326 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742507 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742643 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742813 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.742939 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743128 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743263 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743449 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743583 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743784 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.743925 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744093 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744228 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744396 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744523 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744701 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.744841 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745003 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745130 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745306 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745437 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745613 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745752 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.745918 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746044 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746220 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746347 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746522 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746658 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746826 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.746961 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747128 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747253 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747429 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747556 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747747 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.747886 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748051 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748176 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748354 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748481 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748655 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748790 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.748956 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749090 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749255 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749384 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749555 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749689 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749854 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.749981 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750155 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750291 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750460 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750588 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750763 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.750900 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.751067 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.751220 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.751413 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.753442 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.753596 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.753738 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.753880 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.754015 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.754140 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.754714 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.754848 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.754984 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755109 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755238 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755362 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755617 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755757 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.755900 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.756932 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757075 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757211 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757337 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757470 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757719 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757843 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.757973 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758097 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758223 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758347 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758470 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758593 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758715 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758838 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.758970 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759093 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759217 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759345 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759475 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759598 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759779 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.759908 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760038 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760171 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760296 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760428 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760552 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760682 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760806 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.760935 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761058 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761189 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761314 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761437 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761560 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761690 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761813 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.761943 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762074 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762198 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762322 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762451 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762583 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762697 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762818 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.762948 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763071 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763193 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763340 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763474 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763598 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763738 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763864 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.763987 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764173 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764301 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764426 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764550 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764672 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764804 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.764929 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765052 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765175 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765304 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765418 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765555 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109016) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 09:42:43.765687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.765687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.766254 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:42:43.766254 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109015) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 09:42:43.788349 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_db.sqlalchemy.engines [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:43.789886 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:43.850962 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.context [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),463f4e36-bb1e-4421-b4b9-54d886540532(cell1) {{(pid=109016) load_cells /opt/stack/nova/nova/context.py:464}} May 11 09:42:43.851682 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.context [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),463f4e36-bb1e-4421-b4b9-54d886540532(cell1) {{(pid=109015) load_cells /opt/stack/nova/nova/context.py:464}} May 11 09:42:43.855276 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_concurrency.lockutils [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:42:43.855957 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:42:43.856914 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_concurrency.lockutils [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:42:43.857546 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:42:43.857714 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_concurrency.lockutils [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:42:43.858329 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:42:43.859628 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_concurrency.lockutils [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109016) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:42:43.860227 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:42:43.870890 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_db.sqlalchemy.engines [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:43.874338 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_db.sqlalchemy.engines [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:43.877985 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:43.881267 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:44.033236 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG oslo_db.sqlalchemy.engines [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109016) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:44.041261 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_db.sqlalchemy.engines [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109015) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:42:44.373691 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: WARNING keystonemiddleware.auth_token [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:42:44.375112 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: WARNING keystonemiddleware.auth_token [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:42:44.381480 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: WARNING keystonemiddleware.auth_token [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:42:44.382967 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: WARNING keystonemiddleware.auth_token [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:42:44.724581 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: WARNING keystonemiddleware.auth_token [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:42:44.725360 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: WARNING keystonemiddleware.auth_token [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:42:44.730658 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: WARNING keystonemiddleware.auth_token [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:42:44.731418 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: WARNING keystonemiddleware.auth_token [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:42:44.736753 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562af67c79c0 pid: 109016 (default app) May 11 09:42:44.737574 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562af67c79c0 pid: 109015 (default app) May 11 09:42:44.738806 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:42:44.740001 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-45287ee2-2cb8-43b5-8690-323f3d941a5c None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 May 11 09:42:44.740411 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Wed May 11 09:42:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:02.298041 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:02.299909 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003234 May 11 09:44:02.300471 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:02.722232 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-61c660c0-356a-4f29-9149-9c9c2740605c admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:02.751603 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-61c660c0-356a-4f29-9149-9c9c2740605c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.445154 May 11 09:44:02.752447 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 2/3] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 09:44:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:05.034323 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:05.035312 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-fb7d8821-0369-4168-b542-a4407795ff99 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 11 09:44:05.035733 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 2/4] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:05.096534 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-c271e9ed-506e-47a5-b409-868a652bc633 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:05.115098 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:44:05.115098 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: warnings.warn(msg) May 11 09:44:05.143923 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-c271e9ed-506e-47a5-b409-868a652bc633 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102421 May 11 09:44:05.144578 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 3/5] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:05.362587 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-179a311c-7fc5-4c9c-acb8-eb2d026351e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:05.365093 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:44:05.365093 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:44:05.413269 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-179a311c-7fc5-4c9c-acb8-eb2d026351e0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260668 May 11 09:44:05.414042 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 3/6] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 09:44:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:07.669728 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-c271e9ed-506e-47a5-b409-868a652bc633 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:07.671446 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-c271e9ed-506e-47a5-b409-868a652bc633 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 May 11 09:44:07.672086 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 4/7] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:07.782706 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-c2144277-8ad8-47d5-996d-412f591ea61d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "swap": 0}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:07.800445 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:44:07.800445 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:44:07.817903 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-c2144277-8ad8-47d5-996d-412f591ea61d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135771 May 11 09:44:07.818630 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 4/8] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:07.830766 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-0907f502-5b02-4476-b65c-e764aaa0f0e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:07.832325 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:44:07.832325 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: warnings.warn(msg) May 11 09:44:07.866618 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-0907f502-5b02-4476-b65c-e764aaa0f0e9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039999 May 11 09:44:07.867122 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 5/9] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 09:44:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:10.196747 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-c2144277-8ad8-47d5-996d-412f591ea61d admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:10.198451 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-c2144277-8ad8-47d5-996d-412f591ea61d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 May 11 09:44:10.199021 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:10.263429 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-412f9495-09fc-471a-972c-fd09063f28fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "swap": 0, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:10.282144 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-412f9495-09fc-471a-972c-fd09063f28fc admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074013 May 11 09:44:10.282869 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 6/11] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:10.294775 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-5a74ab61-fb1b-4677-81b9-83a668ba29f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:10.315914 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-5a74ab61-fb1b-4677-81b9-83a668ba29f8 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024732 May 11 09:44:10.316687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 6/12] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 09:44:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:12.615295 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-412f9495-09fc-471a-972c-fd09063f28fc admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:12.616513 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-412f9495-09fc-471a-972c-fd09063f28fc admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 May 11 09:44:12.616934 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 7/13] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:12.680355 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-26ceb995-a7a3-4450-8e26-d0ad1313c4cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "swap": 0}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:12.702989 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-26ceb995-a7a3-4450-8e26-d0ad1313c4cf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078881 May 11 09:44:12.703567 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 7/14] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:44:12.716274 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-97c901de-d2d0-4a32-96de-fab5d30069e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:12.739926 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-97c901de-d2d0-4a32-96de-fab5d30069e6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027663 May 11 09:44:12.740740 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 8/15] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 09:44:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:44:15.098066 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-26ceb995-a7a3-4450-8e26-d0ad1313c4cf admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:15.099091 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-26ceb995-a7a3-4450-8e26-d0ad1313c4cf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 11 09:44:15.099790 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 8/16] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:15.166540 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:15.185539 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079923 May 11 09:44:15.186107 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 9/17] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:44:15.197965 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-4c893153-d8e0-46d4-9fa4-e979d1fe63b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:15.226163 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-4c893153-d8e0-46d4-9fa4-e979d1fe63b0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031858 May 11 09:44:15.228348 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 9/18] 10.222.0.44 () {64 vars in 1335 bytes} [Wed May 11 09:44:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:17.492711 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:17.493915 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 May 11 09:44:17.494998 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 10/19] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:17.561240 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d9a521c3-f88c-48fd-a5a1-61d76567c32c admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:17.586863 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d9a521c3-f88c-48fd-a5a1-61d76567c32c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084544 May 11 09:44:17.587756 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 10/20] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 09:44:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:20.096173 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:20.099326 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-7ec7f515-a979-46eb-a521-dbead34166ea admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002149 May 11 09:44:20.100167 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 11/21] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:20.173722 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-7559707b-4184-472e-a08a-5dd33129a870 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "vcpus": 1}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:20.191712 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-7559707b-4184-472e-a08a-5dd33129a870 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.083236 May 11 09:44:20.192287 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 11/22] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:20 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:44:20.205517 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-3db27be1-b4e0-4aa5-a79f-c45a93e39ab7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:20.232164 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-3db27be1-b4e0-4aa5-a79f-c45a93e39ab7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031498 May 11 09:44:20.232925 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 12/23] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 09:44:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:22.527538 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-7559707b-4184-472e-a08a-5dd33129a870 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:22.528591 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-7559707b-4184-472e-a08a-5dd33129a870 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 11 09:44:22.529002 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:22.588010 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-0bf2a1e8-9873-41cf-bfbb-340f136dd461 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 2048}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:22.606552 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-0bf2a1e8-9873-41cf-bfbb-340f136dd461 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071124 May 11 09:44:22.607121 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 13/25] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:44:22.619161 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-cbdee195-fdac-4b02-ac2f-a824d4eb8480 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:22.646844 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-cbdee195-fdac-4b02-ac2f-a824d4eb8480 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031063 May 11 09:44:22.647844 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 13/26] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 09:44:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:44:24.914127 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-0bf2a1e8-9873-41cf-bfbb-340f136dd461 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:24.915144 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-0bf2a1e8-9873-41cf-bfbb-340f136dd461 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 11 09:44:24.915758 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 14/27] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:24.974566 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-66ebbb8c-625c-4d0e-a3d6-540d0a496a22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "id": "3", "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:24.994767 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-66ebbb8c-625c-4d0e-a3d6-540d0a496a22 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072622 May 11 09:44:24.995340 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 14/28] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:25.007452 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-1e6654d9-84cd-4a0a-bd81-488dcde8cfd6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:25.030905 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-1e6654d9-84cd-4a0a-bd81-488dcde8cfd6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027136 May 11 09:44:25.031493 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 15/29] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 09:44:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:27.278103 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-66ebbb8c-625c-4d0e-a3d6-540d0a496a22 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:27.279122 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-66ebbb8c-625c-4d0e-a3d6-540d0a496a22 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 May 11 09:44:27.279529 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 15/30] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:27.334684 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-482b5d63-ceb6-4da8-a24b-2254435a160a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "rxtx_factor": 1.0, "ram": 8192, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:27.353862 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-482b5d63-ceb6-4da8-a24b-2254435a160a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.068449 May 11 09:44:27.354422 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 16/31] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:27.366536 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-c26dc523-afc8-49db-91f0-c6119647a0f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:27.391360 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-c26dc523-afc8-49db-91f0-c6119647a0f7 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028455 May 11 09:44:27.392078 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 16/32] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 09:44:27 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:29.716934 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-482b5d63-ceb6-4da8-a24b-2254435a160a admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:29.718849 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-482b5d63-ceb6-4da8-a24b-2254435a160a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002351 May 11 09:44:29.719250 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:29.815528 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge"}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:29.896327 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.171128 May 11 09:44:29.896894 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 17/34] 10.222.0.44 () {64 vars in 1282 bytes} [Wed May 11 09:44:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:44:29.909206 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-a563a4ba-ab2f-4853-93ab-15acccd6065f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:29.932196 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-a563a4ba-ab2f-4853-93ab-15acccd6065f admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026725 May 11 09:44:29.932783 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 18/35] 10.222.0.44 () {64 vars in 1332 bytes} [Wed May 11 09:44:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:44:54.527249 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:54.528411 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 May 11 09:44:54.528807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 18/36] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:44:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:44:54.586883 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-4fc34f64-a739-4a75-9c1b-8f7563a3ae24 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:54.604427 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-4fc34f64-a739-4a75-9c1b-8f7563a3ae24 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069481 May 11 09:44:54.604968 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 19/37] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 09:44:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:55.599080 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:55.600112 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d1e3e6a6-caf9-44f3-9e68-c48670238ab6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 11 09:44:55.600515 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:44:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:55.804521 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7333da6e-b60b-4fec-a54a-2230c6ffb12e admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:55.810582 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.wsgi [None req-7333da6e-b60b-4fec-a54a-2230c6ffb12e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7333da6e-b60b-4fec-a54a-2230c6ffb12e admin admin] Request method failure captured: May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept: application/json May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept-Encoding: gzip, deflate May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Connection: keep-alive May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Content-Length: 0 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Host: 10.222.0.44 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-Api-Version: compute 2.90 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-System-Scope: None May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: User-Agent: python-novaclient May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Auth-Token: gAAAAABie4WXe4XYmwVwbm6_Ul8u9dHDxnVHGNYANqu15laHvaNWeAbLVn2xWscR5UXbhe4vnsmp06llEibLOjcijJ8TdoYAgPLLxkUoVvWw8KXJcnmHd6htv7tVmKkR9PP7Se1Us9_OZVa04l0eXLF5mGdTtBEgJL3PArRfkgaYtTdZwepqA9Y May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Id: None May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Name: None May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Identity-Status: Confirmed May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Is-Admin-Project: True May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Id: default May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Name: Default May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Name: admin May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Role: reader,member,admin May 11 09:44:55.813764 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Roles: reader,member,admin May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant: admin May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Name: admin May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User: admin May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Id: default May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Name: Default May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Name: admin May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: method: > May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: exception: Flavor 42 could not be found. May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: action_args: {'id': '42'} May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:55.815430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:55.816369 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:55.817599 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-7333da6e-b60b-4fec-a54a-2230c6ffb12e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:55.818651 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-7333da6e-b60b-4fec-a54a-2230c6ffb12e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060550 May 11 09:44:55.818651 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 20/39] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 09:44:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:55.825634 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-44197be7-10cb-4ab6-bbf6-10e0ccddfe9e admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:55.846202 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-44197be7-10cb-4ab6-bbf6-10e0ccddfe9e admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024895 May 11 09:44:55.846726 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 20/40] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:55.855992 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-321bd6b9-9c86-40ad-a722-274c60f19a89 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:55.876271 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-321bd6b9-9c86-40ad-a722-274c60f19a89 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023847 May 11 09:44:55.876805 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 21/41] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:55.886282 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-982a14be-116d-4c1f-94d5-21ab1ab8aff0 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:55.891559 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.wsgi [None req-982a14be-116d-4c1f-94d5-21ab1ab8aff0 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-982a14be-116d-4c1f-94d5-21ab1ab8aff0 admin admin] Request method failure captured: May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept: application/json May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept-Encoding: gzip, deflate May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Connection: keep-alive May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Content-Length: 0 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Host: 10.222.0.44 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-Api-Version: compute 2.90 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-System-Scope: None May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: User-Agent: python-novaclient May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Auth-Token: gAAAAABie4WXe4XYmwVwbm6_Ul8u9dHDxnVHGNYANqu15laHvaNWeAbLVn2xWscR5UXbhe4vnsmp06llEibLOjcijJ8TdoYAgPLLxkUoVvWw8KXJcnmHd6htv7tVmKkR9PP7Se1Us9_OZVa04l0eXLF5mGdTtBEgJL3PArRfkgaYtTdZwepqA9Y May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Id: None May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Name: None May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Identity-Status: Confirmed May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Is-Admin-Project: True May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Id: default May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Name: Default May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Name: admin May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Role: reader,member,admin May 11 09:44:55.894935 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Roles: reader,member,admin May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant: admin May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Name: admin May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User: admin May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Id: default May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Name: Default May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Name: admin May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: method: > May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: exception: Flavor 42 could not be found. May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: action_args: {'id': '42'} May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:55.896590 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:55.897525 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:55.898831 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-982a14be-116d-4c1f-94d5-21ab1ab8aff0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:55.900867 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-982a14be-116d-4c1f-94d5-21ab1ab8aff0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013998 May 11 09:44:55.900867 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 21/42] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 09:44:55 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:56.795342 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-321bd6b9-9c86-40ad-a722-274c60f19a89 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:56.796467 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-321bd6b9-9c86-40ad-a722-274c60f19a89 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 May 11 09:44:56.796863 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 22/43] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:56.982215 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-2c7ba4f8-ba58-4a6d-8ec4-1078b3ac20b2 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:56.987426 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.wsgi [None req-2c7ba4f8-ba58-4a6d-8ec4-1078b3ac20b2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-2c7ba4f8-ba58-4a6d-8ec4-1078b3ac20b2 admin admin] Request method failure captured: May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept: application/json May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept-Encoding: gzip, deflate May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Connection: keep-alive May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Content-Length: 0 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Host: 10.222.0.44 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-Api-Version: compute 2.90 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-System-Scope: None May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: User-Agent: python-novaclient May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Auth-Token: gAAAAABie4WYIuvYzlWwlSo77u0f7efjUJF5Q_W38AnYib26xktf1UFvZ3HbHcbBTJmIPvJaPrrKmhuonfG2fzzrWIdkJGbPDQhOc9elq8Li0NoqA4yxQjeD08cZUfOW7PMQvVWGztuFkSw1BGzxKXiKXrivaGdMF1pfqYPhbQIuzRVlFhom2U8 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Id: None May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Name: None May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Identity-Status: Confirmed May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Is-Admin-Project: True May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Id: default May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Name: Default May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Name: admin May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Role: reader,member,admin May 11 09:44:56.988962 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Roles: reader,member,admin May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant: admin May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Name: admin May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User: admin May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Id: default May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Name: Default May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Name: admin May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: method: > May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: exception: Flavor 84 could not be found. May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: action_args: {'id': '84'} May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:56.990498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:56.991441 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:56.992801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-2c7ba4f8-ba58-4a6d-8ec4-1078b3ac20b2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:56.994125 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-2c7ba4f8-ba58-4a6d-8ec4-1078b3ac20b2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058753 May 11 09:44:56.994125 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 22/44] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 09:44:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:56.999939 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-f2eb1770-bb82-4805-9ae4-8a91a3c97698 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:57.013164 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-f2eb1770-bb82-4805-9ae4-8a91a3c97698 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016773 May 11 09:44:57.013688 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 23/45] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:57.022830 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-35dd348a-8992-4d58-bbd5-9f8a4b6c23c0 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:57.037144 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-35dd348a-8992-4d58-bbd5-9f8a4b6c23c0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 May 11 09:44:57.037669 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:44:57.047021 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-44942f4f-1426-4c4c-acd7-bd0e06479ad3 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:57.052105 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.wsgi [None req-44942f4f-1426-4c4c-acd7-bd0e06479ad3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-44942f4f-1426-4c4c-acd7-bd0e06479ad3 admin admin] Request method failure captured: May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept: application/json May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept-Encoding: gzip, deflate May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Connection: keep-alive May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Content-Length: 0 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Host: 10.222.0.44 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-Api-Version: compute 2.90 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-System-Scope: None May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: User-Agent: python-novaclient May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Auth-Token: gAAAAABie4WYIuvYzlWwlSo77u0f7efjUJF5Q_W38AnYib26xktf1UFvZ3HbHcbBTJmIPvJaPrrKmhuonfG2fzzrWIdkJGbPDQhOc9elq8Li0NoqA4yxQjeD08cZUfOW7PMQvVWGztuFkSw1BGzxKXiKXrivaGdMF1pfqYPhbQIuzRVlFhom2U8 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Id: None May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Name: None May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Identity-Status: Confirmed May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Is-Admin-Project: True May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Id: default May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Name: Default May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Name: admin May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Role: reader,member,admin May 11 09:44:57.053596 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Roles: reader,member,admin May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant: admin May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Name: admin May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User: admin May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Id: default May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Name: Default May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Name: admin May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: method: > May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: exception: Flavor 84 could not be found. May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: action_args: {'id': '84'} May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:57.055132 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:57.056137 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:57.057175 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-44942f4f-1426-4c4c-acd7-bd0e06479ad3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:57.058185 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-44942f4f-1426-4c4c-acd7-bd0e06479ad3 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011345 May 11 09:44:57.058185 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 24/47] 10.222.0.44 () {60 vars in 1190 bytes} [Wed May 11 09:44:57 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:57.929067 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-35dd348a-8992-4d58-bbd5-9f8a4b6c23c0 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:57.930075 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-35dd348a-8992-4d58-bbd5-9f8a4b6c23c0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 11 09:44:57.930476 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 24/48] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:44:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:58.114780 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-a9bae5ec-020d-4b98-9d94-c586721857f0 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:58.120368 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.wsgi [None req-a9bae5ec-020d-4b98-9d94-c586721857f0 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-a9bae5ec-020d-4b98-9d94-c586721857f0 admin admin] Request method failure captured: May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept: application/json May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Accept-Encoding: gzip, deflate May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Connection: keep-alive May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Content-Length: 0 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Host: 10.222.0.44 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-Api-Version: compute 2.90 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Openstack-System-Scope: None May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: User-Agent: python-novaclient May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Auth-Token: gAAAAABie4WZvLXkHeiKiQDX3MuLD4piTJvEiNfc_r2DpDx5hsFF45WuVBnpFldGfTV1QytbOwsZkKLPjnddmtadc4La7JFEyrxlSHCNgD9sN50OQxTiCq0LkNyzINpjRnjcXPVRE46h9IV6xkFrEFhZqYOTz9EAFPG46cu4N7ZcaCQ-dEO3OH0 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Id: None May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Domain-Name: None May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Identity-Status: Confirmed May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Is-Admin-Project: True May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Id: default May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Domain-Name: Default May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Project-Name: admin May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Role: reader,member,admin May 11 09:44:58.121865 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Roles: reader,member,admin May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant: admin May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-Tenant-Name: admin May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User: admin May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Id: default May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Domain-Name: Default May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: X-User-Name: admin May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: method: > May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: exception: Flavor 451 could not be found. May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: action_args: {'id': '451'} May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:58.123395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:58.124408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: ERROR nova.api.openstack.wsgi May 11 09:44:58.125732 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-a9bae5ec-020d-4b98-9d94-c586721857f0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109016) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:58.126969 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-a9bae5ec-020d-4b98-9d94-c586721857f0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058491 May 11 09:44:58.126969 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 25/49] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:44:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:58.132810 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-7c0d40ad-1a14-43da-bb96-8dd1f276aa4a admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:58.146589 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-7c0d40ad-1a14-43da-bb96-8dd1f276aa4a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017250 May 11 09:44:58.147054 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 25/50] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:58.156936 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:58.170282 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017093 May 11 09:44:58.170800 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 26/51] 10.222.0.44 () {60 vars in 1210 bytes} [Wed May 11 09:44:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:44:58.179789 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d647fd54-7aa1-473e-ac6a-79a0c79f24ac admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:58.185013 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.wsgi [None req-d647fd54-7aa1-473e-ac6a-79a0c79f24ac admin admin] HTTP exception thrown: Flavor 451 could not be found. May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d647fd54-7aa1-473e-ac6a-79a0c79f24ac admin admin] Request method failure captured: May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept: application/json May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Accept-Encoding: gzip, deflate May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Connection: keep-alive May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Content-Length: 0 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Host: 10.222.0.44 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-Api-Version: compute 2.90 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Openstack-System-Scope: None May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: User-Agent: python-novaclient May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Auth-Token: gAAAAABie4WZvLXkHeiKiQDX3MuLD4piTJvEiNfc_r2DpDx5hsFF45WuVBnpFldGfTV1QytbOwsZkKLPjnddmtadc4La7JFEyrxlSHCNgD9sN50OQxTiCq0LkNyzINpjRnjcXPVRE46h9IV6xkFrEFhZqYOTz9EAFPG46cu4N7ZcaCQ-dEO3OH0 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Id: None May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Domain-Name: None May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Identity-Status: Confirmed May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Is-Admin-Project: True May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Openstack-Nova-Api-Version: 2.90 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Id: default May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Domain-Name: Default May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Project-Name: admin May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Role: reader,member,admin May 11 09:44:58.186535 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Roles: reader,member,admin May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_aa4cee0d5d7b46bc89f6aa97f0fccd84", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/aa4cee0d5d7b46bc89f6aa97f0fccd84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant: admin May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Id: aa4cee0d5d7b46bc89f6aa97f0fccd84 May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-Tenant-Name: admin May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User: admin May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Id: default May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Domain-Name: Default May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Id: c3503727ec0d49019b85b78baaff675a May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: X-User-Name: admin May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: method: > May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: exception: Flavor 451 could not be found. May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: action_args: {'id': '451'} May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:44:58.187931 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:58.188807 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: ERROR nova.api.openstack.wsgi May 11 09:44:58.189920 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d647fd54-7aa1-473e-ac6a-79a0c79f24ac admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109015) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:44:58.190933 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d647fd54-7aa1-473e-ac6a-79a0c79f24ac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011702 May 11 09:44:58.190933 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 26/52] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:44:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 11 09:44:59.069012 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:44:59.070023 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 11 09:44:59.070422 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 27/53] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:44:59.254264 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-dfea0966-3128-4608-8cce-3e8e0cd20923 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:44:59.271376 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-dfea0966-3128-4608-8cce-3e8e0cd20923 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068048 May 11 09:44:59.272101 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 27/54] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 09:44:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:45:00.190073 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:45:00.191068 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 11 09:45:00.191462 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:45:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:45:00.378245 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-e6c21b2d-d612-4e88-8d56-4208cbabeb60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:45:00.399151 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-e6c21b2d-d612-4e88-8d56-4208cbabeb60 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071540 May 11 09:45:00.399798 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 28/56] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 09:45:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:45:01.319495 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:45:01.320510 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 11 09:45:01.320911 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 29/57] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:45:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:45:01.506632 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-b6ae6c13-df1a-4aa7-b254-53467d1556f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:45:01.523383 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-b6ae6c13-df1a-4aa7-b254-53467d1556f3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067433 May 11 09:45:01.523967 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 29/58] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 09:45:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:45:02.401252 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:45:02.402270 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 11 09:45:02.402685 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 30/59] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:45:02.587630 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-0ed85805-5d5f-40dd-a413-9adcd16cdcfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:45:02.605348 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-0ed85805-5d5f-40dd-a413-9adcd16cdcfd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067322 May 11 09:45:02.605877 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 30/60] 10.222.0.44 () {64 vars in 1235 bytes} [Wed May 11 09:45:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:45:03.487046 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:45:03.488089 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 11 09:45:03.488479 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 31/61] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:45:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:45:03.672023 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-bdd52d01-ff82-40be-af1d-1c863f469938 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:45:03.690381 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-bdd52d01-ff82-40be-af1d-1c863f469938 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068701 May 11 09:45:03.690917 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 31/62] 10.222.0.44 () {60 vars in 1202 bytes} [Wed May 11 09:45:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:46:05.630910 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.632031 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-8e46d33a-bcf3-4a12-af54-afa5d0b8e911 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 11 09:46:05.632436 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 32/63] 10.222.0.44 () {54 vars in 930 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:46:05.690852 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-d87d1101-1113-41b2-9133-906cfb1c50ac admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.710033 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-d87d1101-1113-41b2-9133-906cfb1c50ac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071811 May 11 09:46:05.710568 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 32/64] 10.222.0.44 () {60 vars in 1291 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:46:05.733185 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-aa124f64-aa9d-47b1-93fd-2565c5ea6ae5 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.741552 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-aa124f64-aa9d-47b1-93fd-2565c5ea6ae5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012512 May 11 09:46:05.742073 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 33/65] 10.222.0.44 () {60 vars in 1282 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:46:05.753118 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-4832e722-68a3-44f7-bdb1-f884f3f155ac admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.760495 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-4832e722-68a3-44f7-bdb1-f884f3f155ac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010893 May 11 09:46:05.760999 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 33/66] 10.222.0.44 () {60 vars in 1285 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:46:05.772160 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.779292 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010561 May 11 09:46:05.779835 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 34/67] 10.222.0.44 () {60 vars in 1285 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:46:05.791464 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-cc270f1b-b6a5-4cb0-a746-c984460dbb11 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:46:05.799177 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-cc270f1b-b6a5-4cb0-a746-c984460dbb11 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010891 May 11 09:46:05.799681 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 34/68] 10.222.0.44 () {60 vars in 1282 bytes} [Wed May 11 09:46:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:49:19.926260 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:19.927267 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 11 09:49:19.928230 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 35/69] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:49:20.198930 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:20.200144 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:49:20.200144 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:49:20.201371 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:20.201814 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:20.202687 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:20.203119 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:20.236219 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-2e6b99e9-e02c-4e59-bf1b-bfa04b1931e3 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154075 May 11 09:49:20.236780 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 35/70] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:49:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:49:21.132408 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:21.133405 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 11 09:49:21.133799 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 36/71] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:49:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:49:21.321140 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:21.322330 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:49:21.322330 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:49:21.323503 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:21.323966 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:21.324743 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:21.325167 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:21.344205 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-c16bb487-dd33-4cee-905e-e210561d1964 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073823 May 11 09:49:21.344677 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 36/72] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:49:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:49:32.661430 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:32.662417 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 11 09:49:32.663395 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 37/73] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:49:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:49:32.852223 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:32.853625 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:49:32.853625 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:49:32.854801 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:32.855238 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:32.856075 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:32.856498 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:32.881556 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-9ae0a2b9-3d12-4af5-843c-228f0a1a9e48 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081187 May 11 09:49:32.882033 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 37/74] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:49:32 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:49:33.780535 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: DEBUG nova.api.openstack.wsgi [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] Calling method '>' {{(pid=109016) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:33.781538 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: INFO nova.api.openstack.requestlog [None req-94950051-06eb-4f06-8bef-55b961d48544 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 11 09:49:33.781939 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: [pid: 109016|app: 0|req: 38/75] 10.222.0.44 () {56 vars in 1074 bytes} [Wed May 11 09:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:49:33.971195 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG nova.api.openstack.wsgi [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] Calling method '>' {{(pid=109015) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:49:33.972390 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 11 09:49:33.972390 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: warnings.warn(msg) May 11 09:49:33.973564 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:33.974002 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:33.974782 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:49:33.975851 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: DEBUG oslo_concurrency.lockutils [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109015) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:49:33.996737 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: INFO nova.api.openstack.requestlog [None req-2dc5e863-9f75-4616-a7fd-f57993914282 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.075494 May 11 09:49:33.997217 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: [pid: 109015|app: 0|req: 38/76] 10.222.0.44 () {60 vars in 1193 bytes} [Wed May 11 09:49:33 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:50:30.294689 dv-cinder-836996-21-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 11 09:50:30.295673 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: Wed May 11 09:50:30 2022 - graceful shutdown triggered... May 11 09:50:30.296424 dv-cinder-836996-21-iscsi devstack@n-api.service[109016]: Gracefully killing worker 2 (pid: 109016)... May 11 09:50:30.296973 dv-cinder-836996-21-iscsi devstack@n-api.service[109015]: Gracefully killing worker 1 (pid: 109015)... May 11 09:50:31.296136 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: worker 1 buried after 1 seconds May 11 09:50:31.296588 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: worker 2 buried after 1 seconds May 11 09:50:31.296588 dv-cinder-836996-21-iscsi devstack@n-api.service[109014]: goodbye to uWSGI. May 11 09:50:31.297710 dv-cinder-836996-21-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 11 09:50:31.298268 dv-cinder-836996-21-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 11 09:50:31.301059 dv-cinder-836996-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 11 09:50:31.320412 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 11 09:50:31 2022] *** May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: nodename: dv-cinder-836996-21-iscsi May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: machine: x86_64 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: clock source: unix May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: pcre jit disabled May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: detected number of CPU cores: 4 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: current working directory: / May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: detected binary path: /usr/bin/uwsgi-core May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: your processes number limit is 47680 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: your memory page size is 4096 bytes May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: detected max file descriptor number: 2048 May 11 09:50:31.353621 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: lock engine: pthread robust mutexes May 11 09:50:31.354748 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: thunder lock: enabled May 11 09:50:31.354748 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 11 09:50:31.354748 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 11 09:50:31.400112 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: Python main interpreter initialized at 0x56420f6029c0 May 11 09:50:31.400112 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: python threads support enabled May 11 09:50:31.400112 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: your server socket listen backlog is limited to 100 connections May 11 09:50:31.400112 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: your mercy for graceful operations on workers is 90 seconds May 11 09:50:31.400515 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: mapped 403077 bytes (393 KB) for 2 cores May 11 09:50:31.400515 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: *** Operational MODE: preforking *** May 11 09:50:31.400776 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: *** uWSGI is running in multiple interpreter mode *** May 11 09:50:31.400776 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: spawned uWSGI master process (pid: 123374) May 11 09:50:31.400986 dv-cinder-836996-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 11 09:50:31.401773 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: spawned uWSGI worker 1 (pid: 123392, cores: 1) May 11 09:50:31.402737 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: spawned uWSGI worker 2 (pid: 123393, cores: 1) May 11 09:50:31.402737 dv-cinder-836996-21-iscsi devstack@n-api.service[123374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 11 09:50:32.620645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 09:50:32.621247 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 11 09:50:33.421398 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:50:33.421398 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: from cryptography.utils import int_from_bytes May 11 09:50:33.421736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:50:33.421736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: from cryptography.utils import int_from_bytes May 11 09:50:33.424826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:50:33.424826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: from cryptography.utils import int_from_bytes May 11 09:50:33.425149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 11 09:50:33.425149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: from cryptography.utils import int_from_bytes May 11 09:50:35.893251 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 09:50:35.893872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 09:50:35.893956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 11 09:50:35.893956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 11 09:50:35.894421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 09:50:35.894421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 09:50:35.894581 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 11 09:50:35.894662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 09:50:35.894743 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 11 09:50:35.895090 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.895201 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 11 09:50:35.895287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.895373 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.895574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.895684 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.895912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896037 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896691 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.896903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897690 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.897949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898155 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898336 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-21-iscsi {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-21-iscsi {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.898957 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899255 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.899893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900048 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900198 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900650 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.900957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.901131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.901466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.901787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.902107 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.902628 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.902867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.903106 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.903344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.903566 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.903831 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.904052 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.904807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.905060 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.905277 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.905501 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.905724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.905941 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.906158 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.906374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.906684 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.906684 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.907120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-21-iscsi {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.907338 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.907555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.907555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-21-iscsi {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.908867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.909043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.909043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.909714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.909872 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910030 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910174 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910624 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.910927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.911113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.911261 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.911409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.911891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.912141 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.912368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.912621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.912788 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.912943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.913925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.914823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915271 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.915776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916231 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916377 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.916733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.917916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918091 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918562 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918707 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918850 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.918999 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.919142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.919329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.920467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.920766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.920935 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921226 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.921974 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.922126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.922277 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.922520 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.922774 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.922936 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923566 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923738 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.923887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924186 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924500 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.924980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.925124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.925281 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.925439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.925586 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.925742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.926072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.926429 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.926591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.926747 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.926899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.927784 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.928781 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.928937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.929093 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.929237 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.929388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.929561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930303 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930457 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930602 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930745 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.930902 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.931058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.933819 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.934951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935254 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935398 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.935936 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936105 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936260 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936412 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.936943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.937096 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.937241 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.937413 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.937612 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.937860 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.938098 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.938098 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.938593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.938593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.939029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.939282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.939282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.939619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.939844 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.940492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.940654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.940808 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.940959 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.941102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.942660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.942660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.943044 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.943217 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.943782 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.943953 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.943953 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.944238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.944395 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.944552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.944705 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.944859 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945594 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.945908 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.946063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.946225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.946225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.946225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.946745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.946890 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.947033 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.947033 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.947319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.947474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.947625 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.947795 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.947952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.948099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.948099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.948403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.948555 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.948709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.948860 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.949012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.949418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.949579 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.949725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.949877 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.950049 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.950346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.950794 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.950972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.951120 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.951295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.951495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 11 09:50:35.951676 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.951875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952452 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952747 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.952900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.953171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.953319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.953494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.953683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.953938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954086 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954394 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.954846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.955863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956013 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956595 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.956892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957632 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957779 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.957929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958648 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958794 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.958952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959389 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959534 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.959864 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960626 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.960963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961057 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961148 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961233 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961700 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961896 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.961989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962152 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962699 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962782 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.962967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963228 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963228 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963387 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963485 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.963664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964190 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.964926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965298 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965393 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965487 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965771 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.965957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966050 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966412 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.966499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.967258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.967360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.967578 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.967680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.967922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968327 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968554 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968656 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.968972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.969927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.970134 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.970228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.970461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.970629 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.970770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971008 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971105 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971704 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.971845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972348 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972768 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.972973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973392 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.973958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.974106 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.974312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.974514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.974840 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975169 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975494 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.975853 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976081 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.976816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.977038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.977142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.977349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.977455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.977862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.978199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.978522 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.978851 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.978953 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.979174 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.979273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.979498 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.979596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.980688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.980857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.980950 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981193 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981476 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981644 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.981999 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.982089 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.982964 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.983147 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.983333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.983622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.983807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.983973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984283 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984430 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.984969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985285 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985611 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.985925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986144 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986553 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.986914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987252 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987411 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987750 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.987865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988390 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988489 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.988810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989026 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989342 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989434 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.989988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990665 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.990967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991403 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.991947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992576 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992676 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.992991 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993211 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993303 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993851 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.993951 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994172 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994266 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994485 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.994906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995443 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995786 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.995900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996205 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996565 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996832 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.996932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997691 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.997781 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998484 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998767 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.998975 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999077 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:35.999953 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000057 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000269 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000361 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000580 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.000988 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001307 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.001930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002556 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.002882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003203 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003761 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.003920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004074 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004182 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.004834 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005016 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.005945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006037 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006887 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.006986 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.007210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.007483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.007594 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.007846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.007950 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008175 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.008905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009452 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009560 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.009875 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010719 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.010828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011151 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.011996 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012090 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012309 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.012933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013246 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013581 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.013954 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014241 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014343 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.014956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015134 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015267 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.015949 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016437 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016608 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.016858 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017048 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017681 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017790 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.017997 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018714 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.018932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019340 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019562 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019656 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.019996 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020211 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020648 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020843 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.020973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021144 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021553 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.021851 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022077 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022185 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022388 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022695 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.022797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023003 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023116 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023746 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.023969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.024174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.024335 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.024478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.024627 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.025985 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026175 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026269 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026632 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.026982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027604 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.027945 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028886 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.028978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.029726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.029845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030352 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030444 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030781 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.030980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031289 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.031934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032554 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.032983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033280 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.033889 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034098 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034198 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034721 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.034813 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035031 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035123 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035644 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.035987 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036295 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.036914 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037317 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.037952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038168 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038485 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038579 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.038965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.039850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040048 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040360 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040665 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.040973 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041281 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041589 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041751 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.041990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042219 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.042968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043455 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043549 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043838 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.043953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.044133 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.044237 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.044450 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.044550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.044772 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.045404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.045659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.045780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.045965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046061 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.046928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047027 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047238 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047331 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047556 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.047990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048213 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048834 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.048928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.049881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050506 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.050819 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051667 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.051850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052002 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052316 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.052796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.053201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.053380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.053536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.053703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.053857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054167 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054343 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054487 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.054809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055181 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055629 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.055812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056194 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056352 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.056983 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057284 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.057915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058233 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.058862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059193 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059731 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.059915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060071 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060381 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060554 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060696 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.060997 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.061274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.061425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.061594 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.061733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.061895 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062046 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062216 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062519 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.062913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063369 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063651 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.063914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064706 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.064807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065016 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065111 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.065793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.066904 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067107 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067213 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.067906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068217 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068753 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.068854 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069068 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069485 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069710 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.069810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070117 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070759 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.070969 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071377 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071704 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.071939 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072254 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072353 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.072917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073746 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.073893 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074034 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074690 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.074980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075267 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075435 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.075885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076468 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076808 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.076903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077237 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.077865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078091 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.078825 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079050 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079361 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.079791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080015 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080109 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080424 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080767 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.080951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081257 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081350 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081565 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081877 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.081979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.082931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083465 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.083910 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084424 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084771 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.084866 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085085 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085178 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085484 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085699 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.085793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086108 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086383 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.086804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087026 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087162 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087442 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087772 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.087982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088093 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088617 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.088926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089564 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.089973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.090183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.090290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.090490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.090591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.090834 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.091027 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.091128 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092355 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092844 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.092948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093168 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093601 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.093917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094226 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094562 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094773 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.094869 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095106 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095594 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095756 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.095857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096525 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096746 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.096905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097070 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097175 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097597 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.097932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098764 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.098857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099198 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099748 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.099847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100071 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100487 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100712 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.100805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101123 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101671 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101772 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.101997 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102098 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.102960 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103411 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.103947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104043 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.104906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105146 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105575 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.105922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106454 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106769 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.106868 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.107084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.107178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.107451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108094 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108635 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.108952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109604 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.109919 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.110013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.110239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.110337 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.110556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.110760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.111871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112198 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.112848 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113068 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113379 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.113796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114001 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114319 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114631 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114735 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.114942 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115256 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.115912 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116021 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.116857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117115 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117439 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.117862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118085 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118204 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118399 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118707 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.118802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119018 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119436 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.119978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120291 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120614 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120716 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.120909 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121531 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.121932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122153 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.122897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123156 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123435 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.123869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124497 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124711 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.124813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125896 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.125998 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126237 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126338 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126861 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.126956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127170 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.127961 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.128193 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.128300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.128507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.128664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.128846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129017 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129167 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129317 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129465 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.129906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130053 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130343 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130492 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130783 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.130951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131611 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.131985 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132205 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132524 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.132969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133194 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133595 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.133913 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.134851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135486 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135715 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.135822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136034 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.136772 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137213 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137505 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137740 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.137842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138750 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.138867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139189 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.139865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140194 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140511 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.140861 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.141836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142352 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.142993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.143338 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.143436 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.143600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.143728 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.143932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144251 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144560 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144870 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.144963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145487 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145588 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.145906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146549 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146731 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.146823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147290 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147597 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147781 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.147933 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.148823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149004 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149163 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149318 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.149915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150065 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150631 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.150932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151511 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.151950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.152970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153612 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153798 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.153901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.154110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.154763 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.154954 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155573 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155721 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.155915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156017 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.156983 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157320 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.157955 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158170 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158269 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.158919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159168 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159437 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159777 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.159902 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160100 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160417 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160732 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.160827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161046 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161360 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.161822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162002 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.162958 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.163118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.163267 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.163407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.163641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.163859 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.164005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.164147 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.164295 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.164820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.164820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 09:50:36.165084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.165084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.165258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.165490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.165806 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.166124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.166446 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.166768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.167100 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.167431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.167782 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.168119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.168470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.168789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.169138 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.169470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.169787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.170652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.170966 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 11 09:50:36.171217 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 11 09:50:36.188772 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.194254 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_db.sqlalchemy.engines [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.254210 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.context [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),463f4e36-bb1e-4421-b4b9-54d886540532(cell1) {{(pid=123392) load_cells /opt/stack/nova/nova/context.py:464}} May 11 09:50:36.258160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.context [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),463f4e36-bb1e-4421-b4b9-54d886540532(cell1) {{(pid=123393) load_cells /opt/stack/nova/nova/context.py:464}} May 11 09:50:36.258680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:50:36.260279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:50:36.261103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:50:36.262505 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:50:36.263040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:50:36.264638 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:50:36.265453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:50:36.267479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:50:36.274737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.276637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.278529 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_db.sqlalchemy.engines [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.284154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_db.sqlalchemy.engines [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.435927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_db.sqlalchemy.engines [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.440063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_db.sqlalchemy.engines [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 11 09:50:36.759602 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:50:36.760488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: WARNING keystonemiddleware.auth_token [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:50:36.768074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:50:36.768492 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: WARNING keystonemiddleware.auth_token [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:50:37.117386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: WARNING keystonemiddleware.auth_token [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:50:37.124196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: WARNING keystonemiddleware.auth_token [None req-fc5ac800-f69a-4dae-a198-19a6324a2f71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:50:37.124431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 11 09:50:37.129397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56420f6029c0 pid: 123393 (default app) May 11 09:50:37.130575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: WARNING keystonemiddleware.auth_token [None req-d77e9a6d-aa78-443d-bc8f-6dd28a6c0395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 11 09:50:37.135863 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56420f6029c0 pid: 123392 (default app) May 11 09:51:19.006882 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5e740614-4444-4a23-afe8-ab6a015d7555 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Action: 'create', calling method: .version_select at 0x7f8bcf4ea280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2073016245", "metadata": {"Type": "work"}}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5e740614-4444-4a23-afe8-ab6a015d7555 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 122 May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:19.028817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2073016245", "metadata": {"Type": "work"}}} May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:19.030610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2073016245', 'metadata': {'Type': 'work'}}}} May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise error May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi '#$%' May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:19.032350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 09:51:19.034088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 09:51:19.035248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 11 09:51:19.035248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.035248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5e740614-4444-4a23-afe8-ab6a015d7555 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:19.035248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5e740614-4444-4a23-afe8-ab6a015d7555 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.147516 May 11 09:51:19.035248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 09:51:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1149 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 09:51:19.044289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8df79207-84b4-496e-b70c-ddbd690226f3 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Action: 'create', calling method: .version_select at 0x7f8bcf37e5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2005946128", "metadata": {"Type": "work"}}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8df79207-84b4-496e-b70c-ddbd690226f3 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 120 May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:19.048270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2005946128", "metadata": {"Type": "work"}}} May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:19.049841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2005946128', 'metadata': {'Type': 'work'}}}} May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise error May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi '0' May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:19.050792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 09:51:19.052079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 09:51:19.053159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 11 09:51:19.053159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.053159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8df79207-84b4-496e-b70c-ddbd690226f3 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:19.053159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8df79207-84b4-496e-b70c-ddbd690226f3 tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010477 May 11 09:51:19.053159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 09:51:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 09:51:19.068255 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e3b5cb9-90cc-4318-982d-1ec0a3c37e3e tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Action: 'create', calling method: .version_select at 0x7f8bcf4ea5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1958243233", "metadata": {"Type": "work"}}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e3b5cb9-90cc-4318-982d-1ec0a3c37e3e tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 119 May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:19.073670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1958243233", "metadata": {"Type": "work"}}} May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:19.075001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1958243233', 'metadata': {'Type': 'work'}}}} May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise error May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi On instance['volume']: May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi '' May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:19.075800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 11 09:51:19.077162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 11 09:51:19.078287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 11 09:51:19.078287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.078287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e3b5cb9-90cc-4318-982d-1ec0a3c37e3e tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:19.078287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e3b5cb9-90cc-4318-982d-1ec0a3c37e3e tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017087 May 11 09:51:19.080561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 09:51:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 11 09:51:19.093550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-673bc39b-ae52-4a35-9ebe-cadc27415dee tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Calling method '.version_select at 0x7f8bcf39d310>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:19.150197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b169c497-7c7b-469f-b9ad-4d5b2a7454dd tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Action: 'create', calling method: .version_select at 0x7f8bcf4eb280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-680012810"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:19.737243 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-673bc39b-ae52-4a35-9ebe-cadc27415dee tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] HTTP exception thrown: Volume tempest-invalid-2113422703 could not be found. May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-673bc39b-ae52-4a35-9ebe-cadc27415dee tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2113422703 HTTP/1.1 May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:19.748496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Volume tempest-invalid-2113422703 could not be found. May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'tempest-invalid-2113422703'} May 11 09:51:19.749875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2113422703 could not be found. (HTTP 404) (Request-ID: req-c2ca23ab-da0c-4fa2-a9b1-274ae5c412f9) May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.750696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:19.751903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2113422703 could not be found. May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:19.755816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2113422703 could not be found. May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2113422703 could not be found. May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-673bc39b-ae52-4a35-9ebe-cadc27415dee tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 404 to user: Volume tempest-invalid-2113422703 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:19.758751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-673bc39b-ae52-4a35-9ebe-cadc27415dee tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2113422703" status: 404 len: 99 microversion: 2.1 time: 0.664273 May 11 09:51:19.760595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 4/4] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 09:51:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2113422703 => generated 99 bytes in 674 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 11 09:51:19.774062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b56493e9-f4c2-4f24-b333-024eb0ff59ff tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005778 May 11 09:51:19.776915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 5/5] 10.222.0.44 () {58 vars in 1139 bytes} [Wed May 11 09:51:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 09:51:19.792373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b2c41601-8d64-4193-9729-a1f7522ef76e tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008472 May 11 09:51:19.793470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 6/6] 10.222.0.44 () {58 vars in 1136 bytes} [Wed May 11 09:51:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 11 09:51:19.831405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af619b24-e937-4627-8e22-d55bf531a38a tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Calling method '.version_select at 0x7f8bcf2c3160>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:20.648119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-af619b24-e937-4627-8e22-d55bf531a38a tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] HTTP exception thrown: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af619b24-e937-4627-8e22-d55bf531a38a tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/os-volumes/adc7e4a9-7e33-4ec2-beeb-000f09c81b7e HTTP/1.1 May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:20.650771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'adc7e4a9-7e33-4ec2-beeb-000f09c81b7e'} May 11 09:51:20.652386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. (HTTP 404) (Request-ID: req-3f88e4b7-8f72-4727-aa38-a9427f78c149) May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.653401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:20.654672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 09:51:20.655978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:20.657186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af619b24-e937-4627-8e22-d55bf531a38a tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 404 to user: Volume adc7e4a9-7e33-4ec2-beeb-000f09c81b7e could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:20.659088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-af619b24-e937-4627-8e22-d55bf531a38a tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/adc7e4a9-7e33-4ec2-beeb-000f09c81b7e" status: 404 len: 109 microversion: 2.1 time: 0.846931 May 11 09:51:20.661067 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 7/7] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:51:19 2022] DELETE /compute/v2.1/os-volumes/adc7e4a9-7e33-4ec2-beeb-000f09c81b7e => generated 109 bytes in 859 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:20.812349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-825400311", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "networks": [{"uuid": "bf6d86c6-a55a-4a73-b646-860da429908d"}]}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:20.892227 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b169c497-7c7b-469f-b9ad-4d5b2a7454dd tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.616743 May 11 09:51:20.900968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 1/8] 10.222.0.44 () {60 vars in 1154 bytes} [Wed May 11 09:51:18 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2627 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 09:51:20.906727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83c44fd1-8cb8-427a-bdd8-031163640efe tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Calling method '.version_select at 0x7f8bcf342280>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:20.974933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-83c44fd1-8cb8-427a-bdd8-031163640efe tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] HTTP exception thrown: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83c44fd1-8cb8-427a-bdd8-031163640efe tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Request method failure captured: May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/os-volumes/53487ddb-a279-49ff-8601-69195ef26f4f HTTP/1.1 May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cV9ynIDkPbcF-fdKECpXn6iS1uZdWFaUTCnWugmg-2pGWJW81N5OGAP9QzafJqPIRVkEnSKpRFa8hYVPK3w93W4Ow83LIkpyQF2G255MGnhzAMirOC5Y7k0Eo1KNbsP_MeJ5YavOK5qTWFJ0mX32vFKRgp0B0yKoV4dk7bwPOLPcs May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:51:20.979363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2f5f94c9bbd34b2bb97b270e64e187ba", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2f5f94c9bbd34b2bb97b270e64e187ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 2f5f94c9bbd34b2bb97b270e64e187ba May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesNegativeTest-1880780043 May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 056829548dd64ac588c4afc7eb028588 May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesNegativeTest-1880780043-project May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '53487ddb-a279-49ff-8601-69195ef26f4f'} May 11 09:51:20.980817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. (HTTP 404) (Request-ID: req-fda8eb65-9539-4389-86ec-759c2de9b436) May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.981654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:20.982836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 09:51:20.984058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-83c44fd1-8cb8-427a-bdd8-031163640efe tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] Returning 404 to user: Volume 53487ddb-a279-49ff-8601-69195ef26f4f could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-83c44fd1-8cb8-427a-bdd8-031163640efe tempest-VolumesNegativeTest-1880780043 tempest-VolumesNegativeTest-1880780043-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/53487ddb-a279-49ff-8601-69195ef26f4f" status: 404 len: 109 microversion: 2.1 time: 0.079506 May 11 09:51:20.988675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 2/9] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:20 2022] GET /compute/v2.1/os-volumes/53487ddb-a279-49ff-8601-69195ef26f4f => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:20.996187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c2583b62-ed66-461c-a93d-503b902f0287 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf317a60>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:21.121111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] validate_networks() for [('bf6d86c6-a55a-4a73-b646-860da429908d', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:51:21.135652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c2583b62-ed66-461c-a93d-503b902f0287 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 200 len: 344 microversion: 2.1 time: 0.143726 May 11 09:51:21.136478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 3/10] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:20 2022] GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:22.150663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fcf9ca62-216e-4bc2-814e-ee511b967ae8 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf3174c0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:22.245277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fcf9ca62-216e-4bc2-814e-ee511b967ae8 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 200 len: 345 microversion: 2.1 time: 0.099340 May 11 09:51:22.246117 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 4/11] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:22 2022] GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:22.258976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8d722b02-14a9-4b1d-a4fe-94e3b3734bba tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Action: 'create', calling method: .version_select at 0x7f8bcf317c10>, body: {"snapshot": {"volume_id": "592e822c-0194-4282-8d58-d50aac6ebaa7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1685310434"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:22.662339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8d722b02-14a9-4b1d-a4fe-94e3b3734bba tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.408154 May 11 09:51:22.663034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 5/12] 10.222.0.44 () {60 vars in 1161 bytes} [Wed May 11 09:51:22 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:22.673225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a8cc1e9-a3b2-42b5-a6c9-d42720a6c8e1 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf333820>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:22.763345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a8cc1e9-a3b2-42b5-a6c9-d42720a6c8e1 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.094053 May 11 09:51:22.764408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 6/13] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:22 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:22.776488 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b45cce65-8b67-4f8e-8330-2d72159df685 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf317790>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:22.859641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b45cce65-8b67-4f8e-8330-2d72159df685 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.087583 May 11 09:51:22.860621 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 7/14] 10.222.0.44 () {58 vars in 1139 bytes} [Wed May 11 09:51:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:22.873050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5fab6e89-f6af-47b8-b243-8a2ea37bff9a tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf333a60>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:22.934718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5fab6e89-f6af-47b8-b243-8a2ea37bff9a tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.066366 May 11 09:51:22.935626 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 8/15] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:22 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:22.960067 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:51:22.960588 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:51:22.960963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:51:22.961367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:51:22.961777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:51:22.993085 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:22.996346 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:22.997740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:23.001629 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:23.076367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Getting quotas for project 749504c9ac8140ff9436f595b73afbb1. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:23.097482 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Getting quotas for user 5e725fa4d9cc46c1b9578109d1daa9b2 and project 749504c9ac8140ff9436f595b73afbb1. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:23.119681 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:51:23.123493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:51:23.276222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9098deb7-b4a8-4f81-a90a-fe5e29f974d3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613007 May 11 09:51:23.277181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 8/16] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:51:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:51:23.288002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3524c856-a048-4542-9f0e-3df56db1c414 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:23.288759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3524c856-a048-4542-9f0e-3df56db1c414 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:23.439357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3524c856-a048-4542-9f0e-3df56db1c414 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:23.478479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3524c856-a048-4542-9f0e-3df56db1c414 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1214 microversion: 2.1 time: 0.194849 May 11 09:51:23.482523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 9/17] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:23 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:23.948878 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-32349552-3ac2-417e-a473-231c2533de6e tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ce3a0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:24.040073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-32349552-3ac2-417e-a473-231c2533de6e tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.096875 May 11 09:51:24.042009 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 9/18] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:23 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:24.496088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42728413-3910-4e19-b9b0-c3baec021efc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:24.496741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42728413-3910-4e19-b9b0-c3baec021efc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:24.958596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42728413-3910-4e19-b9b0-c3baec021efc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:24.969248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42728413-3910-4e19-b9b0-c3baec021efc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1214 microversion: 2.1 time: 0.475339 May 11 09:51:24.970195 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 10/19] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:24 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1214 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:25.052725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-28702d8e-b723-4fc7-b03a-65396c9d35f1 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ceaf0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:25.126121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-28702d8e-b723-4fc7-b03a-65396c9d35f1 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.077244 May 11 09:51:25.126903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 10/20] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:25 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:25.988659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:25.989457 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:26.006803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:26.008228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:26.011263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:26.013073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:26.138791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-876a6655-76ac-4e45-81e5-f297f3145756 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9df1f0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:26.220082 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-876a6655-76ac-4e45-81e5-f297f3145756 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 288 microversion: 2.1 time: 0.085436 May 11 09:51:26.221690 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 11/21] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:26 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:26.232951 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-08926b59-d386-4ff0-ad1d-d87d4a40b1e3 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9cec10>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:26.406653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-08926b59-d386-4ff0-ad1d-d87d4a40b1e3 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 202 len: 0 microversion: 2.1 time: 0.179259 May 11 09:51:26.410380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 12/22] 10.222.0.44 () {58 vars in 1253 bytes} [Wed May 11 09:51:26 2022] DELETE /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 09:51:26.421574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-56a4233c-f4b3-4434-999f-cde382bff9bd tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ce4c0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:26.478671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-56a4233c-f4b3-4434-999f-cde382bff9bd tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.066242 May 11 09:51:26.479559 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 13/23] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:26 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:26.853966 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:26.874310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-96837bd8-bb20-47bc-9f2c-40bcff357354 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1218 microversion: 2.1 time: 0.891666 May 11 09:51:26.880794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 11/24] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:25 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1218 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:27.490372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f40ee7cc-a3b5-43b1-8141-e463e7c8bd42 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9bdee0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:27.538704 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f40ee7cc-a3b5-43b1-8141-e463e7c8bd42 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.051636 May 11 09:51:27.539518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 14/25] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:27 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:27.902123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:27.902739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:27.912005 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:27.912445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:27.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:27.916486 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:28.277171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:28.286302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-03a5abe1-c9c5-4384-8518-fc3ebd9ff2b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1210 microversion: 2.1 time: 0.389660 May 11 09:51:28.288840 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 12/26] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:27 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1210 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:28.551268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ef336a77-b4c4-43b0-ac83-2371b1df3bee tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ce040>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:28.604543 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ef336a77-b4c4-43b0-ac83-2371b1df3bee tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 200 len: 287 microversion: 2.1 time: 0.058023 May 11 09:51:28.608475 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 15/27] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:28 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:29.305466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:29.306881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:29.329470 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:29.332274 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:29.340411 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:29.341350 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:29.511959 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:29.523630 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e33ae139-9fe6-4b2d-9b59-08bb7250f351 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1266 microversion: 2.1 time: 0.222785 May 11 09:51:29.524276 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 13/28] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:29 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:29.617088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0f959ba4-41f2-499c-b4e8-13b116b0ec87 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ce820>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:29.667518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-0f959ba4-41f2-499c-b4e8-13b116b0ec87 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] HTTP exception thrown: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0f959ba4-41f2-499c-b4e8-13b116b0ec87 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Request method failure captured: May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 HTTP/1.1 May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cW7aONKxp3Qaz4mDsBLzVrovV5DT9R6QleHllNNazIO6My05IT2-nAmLSThVLkQnff0ovJ0HKmwjZ9G74lOlubKaxhhgNnGikY9SlUaC7MOqQBt1Mi30Rgf0YoJe8RGdOD6kKfoOCCMZk0vuWdo3_pzxmPyUf246sK6UbYvcQPezc May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:29.669879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cd6c0bcd88fc44349bde21e0c2fe8eca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 31fa04d0d7994502baaafa51ea82cff1 May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'f0bf66ca-e916-435c-8320-7aa5779620b7'} May 11 09:51:29.671474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. (HTTP 404) (Request-ID: req-3429c369-d9a3-449f-8f0a-3d787eb5e876) May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.673651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:29.674961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 11 09:51:29.676273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0f959ba4-41f2-499c-b4e8-13b116b0ec87 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Returning 404 to user: Snapshot f0bf66ca-e916-435c-8320-7aa5779620b7 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:29.677694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0f959ba4-41f2-499c-b4e8-13b116b0ec87 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7" status: 404 len: 111 microversion: 2.1 time: 0.058951 May 11 09:51:29.683409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8a3c2dbb-5611-4e7c-a0b9-b2a5934f8c9c tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf218310>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:29.691805 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 16/29] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 09:51:29 2022] GET /compute/v2.1/os-snapshots/f0bf66ca-e916-435c-8320-7aa5779620b7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:29.856726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8a3c2dbb-5611-4e7c-a0b9-b2a5934f8c9c tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 202 len: 0 microversion: 2.1 time: 0.177847 May 11 09:51:29.857829 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:51:29 2022] DELETE /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:51:29.871136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-612ad817-f4df-4ff1-90c4-9b2b8e842771 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf327ca0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:29.975118 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-612ad817-f4df-4ff1-90c4-9b2b8e842771 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 200 len: 344 microversion: 2.1 time: 0.112081 May 11 09:51:29.981136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 17/31] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:29 2022] GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:30.539939 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:30.541768 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:30.582186 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:30.586931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:30.586931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:30.587496 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:30.792213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:30.805579 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5713a27b-1357-4273-859f-c88129e96339 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1272 microversion: 2.1 time: 0.269435 May 11 09:51:30.810505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 15/32] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:30 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1272 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:30.988197 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cc50892f-fbf8-4a9e-893f-fe57f44d532b tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9ce160>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:31.031341 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-cc50892f-fbf8-4a9e-893f-fe57f44d532b tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] HTTP exception thrown: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cc50892f-fbf8-4a9e-893f-fe57f44d532b tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Request method failure captured: May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 HTTP/1.1 May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cW7aONKxp3Qaz4mDsBLzVrovV5DT9R6QleHllNNazIO6My05IT2-nAmLSThVLkQnff0ovJ0HKmwjZ9G74lOlubKaxhhgNnGikY9SlUaC7MOqQBt1Mi30Rgf0YoJe8RGdOD6kKfoOCCMZk0vuWdo3_pzxmPyUf246sK6UbYvcQPezc May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:31.033340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cd6c0bcd88fc44349bde21e0c2fe8eca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 31fa04d0d7994502baaafa51ea82cff1 May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '592e822c-0194-4282-8d58-d50aac6ebaa7'} May 11 09:51:31.034362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. (HTTP 404) (Request-ID: req-ff5f3d84-3711-43ca-a192-189412c73c6f) May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.035007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:31.035977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 09:51:31.040590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cc50892f-fbf8-4a9e-893f-fe57f44d532b tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Returning 404 to user: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cc50892f-fbf8-4a9e-893f-fe57f44d532b tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 404 len: 109 microversion: 2.1 time: 0.050265 May 11 09:51:31.041513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 18/33] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:30 2022] GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:31.050832 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee75cb3a-7497-47de-be0b-9b3cd16ee7d0 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bcf26f430>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:31.100203 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ee75cb3a-7497-47de-be0b-9b3cd16ee7d0 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] HTTP exception thrown: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee75cb3a-7497-47de-be0b-9b3cd16ee7d0 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Request method failure captured: May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 HTTP/1.1 May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cW7aONKxp3Qaz4mDsBLzVrovV5DT9R6QleHllNNazIO6My05IT2-nAmLSThVLkQnff0ovJ0HKmwjZ9G74lOlubKaxhhgNnGikY9SlUaC7MOqQBt1Mi30Rgf0YoJe8RGdOD6kKfoOCCMZk0vuWdo3_pzxmPyUf246sK6UbYvcQPezc May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:51:31.102739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cd6c0bcd88fc44349bde21e0c2fe8eca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 31fa04d0d7994502baaafa51ea82cff1 May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '592e822c-0194-4282-8d58-d50aac6ebaa7'} May 11 09:51:31.103807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. (HTTP 404) (Request-ID: req-15934607-a958-4e4c-80ff-52ecf46976fa) May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.104513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 11 09:51:31.105395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 11 09:51:31.109606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ee75cb3a-7497-47de-be0b-9b3cd16ee7d0 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Returning 404 to user: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ee75cb3a-7497-47de-be0b-9b3cd16ee7d0 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 404 len: 109 microversion: 2.1 time: 0.058659 May 11 09:51:31.110573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 16/34] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:51:31 2022] DELETE /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:31.117459 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-abd2c441-f874-4ea0-b65e-ac73c02e4265 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Calling method '.version_select at 0x7f8bce9df790>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:31.183188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-abd2c441-f874-4ea0-b65e-ac73c02e4265 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] HTTP exception thrown: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-abd2c441-f874-4ea0-b65e-ac73c02e4265 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Request method failure captured: May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 HTTP/1.1 May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cW7aONKxp3Qaz4mDsBLzVrovV5DT9R6QleHllNNazIO6My05IT2-nAmLSThVLkQnff0ovJ0HKmwjZ9G74lOlubKaxhhgNnGikY9SlUaC7MOqQBt1Mi30Rgf0YoJe8RGdOD6kKfoOCCMZk0vuWdo3_pzxmPyUf246sK6UbYvcQPezc May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:51:31.185780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_cd6c0bcd88fc44349bde21e0c2fe8eca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/cd6c0bcd88fc44349bde21e0c2fe8eca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: cd6c0bcd88fc44349bde21e0c2fe8eca May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1191225033 May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 31fa04d0d7994502baaafa51ea82cff1 May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1191225033-project May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '592e822c-0194-4282-8d58-d50aac6ebaa7'} May 11 09:51:31.186791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. (HTTP 404) (Request-ID: req-e247a2b4-ee81-4e26-9f95-fd33c9f9a1ce) May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.187411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:51:31.188591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 09:51:31.190552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. May 11 09:51:31.191449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:51:31.194175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-abd2c441-f874-4ea0-b65e-ac73c02e4265 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] Returning 404 to user: Volume 592e822c-0194-4282-8d58-d50aac6ebaa7 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:51:31.195383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-abd2c441-f874-4ea0-b65e-ac73c02e4265 tempest-VolumesSnapshotsTestJSON-1191225033 tempest-VolumesSnapshotsTestJSON-1191225033-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7" status: 404 len: 109 microversion: 2.1 time: 0.082222 May 11 09:51:31.209513 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 19/35] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:51:31 2022] GET /compute/v2.1/os-volumes/592e822c-0194-4282-8d58-d50aac6ebaa7 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:51:31.830230 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:31.830877 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:31.860376 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:31.861538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:31.871521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:31.874405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:32.242175 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:32.252326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf8c4a34-d146-4551-9d5c-eef52dd5f8af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1272 microversion: 2.1 time: 0.427833 May 11 09:51:32.261204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 17/36] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:31 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:32.741736 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-86167d18-9ed6-47eb-a31f-0dda496ef580 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: .version_select at 0x7f8bce9ce040>, body: {"keypair": {"name": "tempest-keypair-897439397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfVV1s4zbd7FLz5/c7klHDD+QnljW4Le/F4IURiEhMbUMl6X8XL6ckzFoiBepio1SGfqKoCe3fFpS7Gw469XhbmBRG1xBT0xM4sCipJVxuYZ+eNdxOJ+B5VxUywKxXRnw=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:32.803369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-86167d18-9ed6-47eb-a31f-0dda496ef580 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:32.810451 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-86167d18-9ed6-47eb-a31f-0dda496ef580 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for user a918dc4737544f3fa38090e2c82aeae6 and project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:32.907587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-86167d18-9ed6-47eb-a31f-0dda496ef580 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.608120 May 11 09:51:32.908731 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 20/37] 10.222.0.44 () {62 vars in 1199 bytes} [Wed May 11 09:51:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 611 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 09:51:33.280243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:33.283309 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:33.302906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:33.304855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:33.305872 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:33.307020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:33.509184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:33.519492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9f5276e-7660-48bb-84d0-295ec0954c73 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1272 microversion: 2.1 time: 0.244721 May 11 09:51:33.533084 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 18/38] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:33 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:34.541676 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:34.542533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:34.572864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:34.574025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:34.576570 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:34.581571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:35.043706 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:35.076690 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ba808ffb-e5d5-48bc-9f8d-c80c90bd2bfb tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1272 microversion: 2.1 time: 0.539727 May 11 09:51:35.097047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 21/39] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:34 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1272 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:36.103552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:36.105051 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:36.125515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:36.128127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:36.131876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:36.133593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:37.241028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:37.270412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-55bf6c3e-bdb3-4956-916d-e47cbe6c53b4 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 1.165596 May 11 09:51:37.271664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 19/40] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:36 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:38.287962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:38.290032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:38.297574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:38.302321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:38.303608 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:38.306837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:38.912521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-97cf0d02-5167-449a-97ef-d26e6c1c60cf tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: .version_select at 0x7f8bcd903e50>, body: {"keypair": {"name": "tempest-keypair-1975583261", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFnnP+XtQndBU11700GgtPAk2XnYblbKg9dN9BGhyTUCNvvcCruJRHb6yCs6w9GQ3RoWo2b6FBNCtvsQ2gFmIvFIQzI8P+9a8kNIP28jRxm1IOsgHDsV9U11iBcgquUcw=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:38.975390 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-97cf0d02-5167-449a-97ef-d26e6c1c60cf tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for project d559012f039049b98f84658174e6f125. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:38.999035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-97cf0d02-5167-449a-97ef-d26e6c1c60cf tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for user 0a535775680c46b7bd5b8348ee0a3a25 and project d559012f039049b98f84658174e6f125. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:39.092249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-97cf0d02-5167-449a-97ef-d26e6c1c60cf tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.560863 May 11 09:51:39.098225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 22/41] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:51:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:39.692609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:39.701304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-54fbf312-2d16-4142-9181-9b605103ab30 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 1.417345 May 11 09:51:39.713698 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 20/42] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:38 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:39.727001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-873561399", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:39.877679 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] validate_networks() for [('92fa9ce6-f537-4fd2-a602-65c692f775d2', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:51:40.719532 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:40.720180 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:40.732303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:40.732799 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:40.733640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:40.734065 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:41.581202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:41.591388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dff93fdd-2364-4674-835a-21f63f89b50a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.874120 May 11 09:51:41.593969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 21/43] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:40 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:42.747984 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-70f744c3-f609-4e9a-ada9-80efda162f54 req-48f6baf0-0c48-49a0-9448-146ad834071f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab5eaf94-60a1-482b-bcae-fefec3fe22c8", "tag": "e24c8195-c437-4310-8a5c-341bb8593462"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:42.769507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-70f744c3-f609-4e9a-ada9-80efda162f54 req-48f6baf0-0c48-49a0-9448-146ad834071f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:42.782860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-70f744c3-f609-4e9a-ada9-80efda162f54 req-48f6baf0-0c48-49a0-9448-146ad834071f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:42.813831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-70f744c3-f609-4e9a-ada9-80efda162f54 req-48f6baf0-0c48-49a0-9448-146ad834071f service nova] Creating event network-changed:e24c8195-c437-4310-8a5c-341bb8593462 for instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 on hv-cinder-83699 May 11 09:51:42.814722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-70f744c3-f609-4e9a-ada9-80efda162f54 req-48f6baf0-0c48-49a0-9448-146ad834071f service nova] Acquired lock "compute-rpcapi-router" {{(pid=123392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 09:51:42.816742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:42.817433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:42.818474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:42.819127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:42.848464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.compute.rpcapi [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 09:51:42.850173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] Releasing lock "compute-rpcapi-router" {{(pid=123392) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 09:51:42.906794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-09059a99-30ea-488f-b854-3806aa15ae14 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.099664 May 11 09:51:42.908091 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 22/44] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:42.913678 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:42.914679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:42.930195 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:42.931150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:42.932216 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:42.933589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:43.178294 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:51:43.179604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:51:43.180326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:51:43.180945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:51:43.182112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:51:43.204326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:43.205199 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:43.211273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:43.212082 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:43.264175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:43.273010 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for user 332b151b87ec412195fab910140cd163 and project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:43.317069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:51:43.321521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:51:43.528191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-af441ad5-60cc-4307-adaf-e94e4cbdd5ea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.252331 May 11 09:51:43.529010 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 23/45] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:51:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 4259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 09:51:43.570008 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1344648796", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9f65fec-6ab4-477b-8f01-74708a6b7e82"}], "security_groups": [{"name": "tempest-securitygroup--1754639614"}], "key_name": "tempest-keypair-897439397", "user_data": "}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:43.597836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:43.609686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9d6e1fb-3a73-42a2-bf58-4eef93f2931d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.700001 May 11 09:51:43.612482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 23/46] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:42 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:43.635843 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4263f3dc-fe19-43b0-9c49-7a3154e2a9c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:43.640207 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4263f3dc-fe19-43b0-9c49-7a3154e2a9c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:44.245412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4263f3dc-fe19-43b0-9c49-7a3154e2a9c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:44.257991 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4263f3dc-fe19-43b0-9c49-7a3154e2a9c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1221 microversion: 2.1 time: 0.642077 May 11 09:51:44.258518 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 24/47] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:43 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1221 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:44.410902 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] validate_networks() for [('c9f65fec-6ab4-477b-8f01-74708a6b7e82', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:51:44.630970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:44.631615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:44.642659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:44.656492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:44.657477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:44.664529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:45.533687 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:45.546564 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ff85ecca-b415-492b-98cd-41eba7e206b8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.917578 May 11 09:51:45.550226 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 25/48] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:44 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:45.563585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-270779235", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:45.856327 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] validate_networks() for [('92fa9ce6-f537-4fd2-a602-65c692f775d2', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:51:47.116480 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:51:47.116999 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:51:47.117637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:51:47.118053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:51:47.118469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:51:47.131920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:47.132300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:47.133359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:47.134428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:47.161588 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:47.172383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for user a918dc4737544f3fa38090e2c82aeae6 and project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:47.199209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:51:47.201713 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:51:47.285733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4338f1b9-68ed-4eb5-9a3d-7ac1bb31ed7b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.753167 May 11 09:51:47.286369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 24/49] 10.222.0.44 () {62 vars in 1187 bytes} [Wed May 11 09:51:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 3757 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 09:51:47.299000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:47.303996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:47.354246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:47.357593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:47.360302 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:47.366196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:47.808937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:47.821667 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-49131fe5-9b71-44e6-b748-06c2135caad6 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.524415 May 11 09:51:47.822432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 25/50] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:47 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:47.836597 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:47.839478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:47.997184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:48.014623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:48.016181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:48.028019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3ee722d1-655d-4068-9ee0-647c2de1db6c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1281 microversion: 2.20 time: 0.204398 May 11 09:51:48.029080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 26/51] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:47 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1281 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:48.738006 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:51:48.738881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:51:48.739379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:51:48.740519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:51:48.743472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:51:48.766768 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:48.767383 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:48.768824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:48.770532 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:48.834849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:48.840102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:48.840879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:48.844209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for user 332b151b87ec412195fab910140cd163 and project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:48.850492 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:48.853291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:48.854428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:48.855289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:48.865850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:51:48.868582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:51:49.003976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c3f8561-47a4-40dd-bc51-900d6fb3a5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.452338 May 11 09:51:49.007533 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 26/52] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:51:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:51:49.043791 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-380094594", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a36be11-c66f-415c-98d4-0d4e370da946"}], "security_groups": [{"name": "tempest-securitygroup--271013147"}], "key_name": "tempest-keypair-1975583261", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:49.247558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:49.259625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-97900fad-fa29-47eb-ba63-1eb568d33d44 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.424603 May 11 09:51:49.265443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:48 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:51:49.271823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7e19e25f-950f-4049-b133-930768132bb2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:49.272442 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7e19e25f-950f-4049-b133-930768132bb2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:49.594159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7e19e25f-950f-4049-b133-930768132bb2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:49.612202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7e19e25f-950f-4049-b133-930768132bb2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1221 microversion: 2.1 time: 0.342950 May 11 09:51:49.613090 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 28/54] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:49 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1221 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:49.627836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:49.628912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:49.656339 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:49.657283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:49.658038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:49.658936 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:49.763228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] validate_networks() for [('6a36be11-c66f-415c-98d4-0d4e370da946', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:51:49.815135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:49.827780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:49.839800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:49.842703 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5f3fe87f-9a93-47de-9543-ec172a83417f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1351 microversion: 2.20 time: 0.227439 May 11 09:51:49.855777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 29/55] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:49 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1351 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:50.278647 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:50.279591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:50.294863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:50.296674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:50.299374 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:50.300041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:50.970490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:50.982326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-01b295b0-3e28-4186-bb41-33b7d2e0d6e8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.709230 May 11 09:51:50.982920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 30/56] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:50 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:51:50.992688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:51.005394 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:51.012897 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:51.013344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:51.014122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:51.018404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:51.140780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:51.153481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2b50e2cd-4a98-459d-93af-73c189d1bae3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1291 microversion: 2.1 time: 0.167750 May 11 09:51:51.154241 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 31/57] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:50 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1291 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:51.165927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:51.170911 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:51.184094 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:51.184765 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:51.185962 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:51.188330 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:51.347711 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:51.359657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:51.361210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:51.370621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2fe3e36a-f11d-43e1-8b1c-7d421bf7cb55 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1339 microversion: 2.20 time: 0.213428 May 11 09:51:51.371206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 32/58] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:51 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:51.998838 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:51.999445 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:52.008598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.009254 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.010595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.011653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.149032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:51:52.153952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:51:52.154701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:51:52.155270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:51:52.155926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:51:52.166682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.168198 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.169729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.170426 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.202004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.203345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for project d559012f039049b98f84658174e6f125. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:51:52.212276 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for user 0a535775680c46b7bd5b8348ee0a3a25 and project d559012f039049b98f84658174e6f125. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:51:52.213609 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-55de9ac2-c9cd-46b0-91dd-49e95bf87740 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.218381 May 11 09:51:52.224890 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 33/59] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:51 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:51:52.231551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:51:52.234268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:52.234934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:51:52.235495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:52.242203 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.243058 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.244434 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.245069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.371745 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9d789db0-8d6d-4942-bd02-6c7930222b51 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.358033 May 11 09:51:52.374302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 27/60] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:51:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 3362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:51:52.395230 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b532e1e-cfa7-4363-b87e-34563e863bc4 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:52.398710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2b532e1e-cfa7-4363-b87e-34563e863bc4 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:52.451120 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.463752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-715420e5-49eb-4d67-b4d7-4bc2c4a1fb2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1279 microversion: 2.1 time: 0.236038 May 11 09:51:52.464977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 34/61] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:52 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:52.470721 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:52.471752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:52.481739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.482680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.483948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:52.484578 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:52.617334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2b532e1e-cfa7-4363-b87e-34563e863bc4 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.625855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2b532e1e-cfa7-4363-b87e-34563e863bc4 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1237 microversion: 2.1 time: 0.244826 May 11 09:51:52.630461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 28/62] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:52 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1237 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:51:52.865809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.880195 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.885981 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:52.889049 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9cb7559b-89dd-4594-bf66-d55e7bf51d7e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1407 microversion: 2.20 time: 0.422466 May 11 09:51:52.890584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 35/63] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:52 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:53.231332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:53.232107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:53.244625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.246795 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.251129 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.253289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.343431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-ddac9f18-fefa-4bbf-8414-7e05a0237e01 req-f40eeb30-01c8-4c5f-ba11-2be1bef71238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5eaf94-60a1-482b-bcae-fefec3fe22c8", "name": "network-vif-plugged", "status": "completed", "tag": "e24c8195-c437-4310-8a5c-341bb8593462"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:53.383955 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ddac9f18-fefa-4bbf-8414-7e05a0237e01 req-f40eeb30-01c8-4c5f-ba11-2be1bef71238 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.384562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-ddac9f18-fefa-4bbf-8414-7e05a0237e01 req-f40eeb30-01c8-4c5f-ba11-2be1bef71238 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.428557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-ddac9f18-fefa-4bbf-8414-7e05a0237e01 req-f40eeb30-01c8-4c5f-ba11-2be1bef71238 service nova] Creating event network-vif-plugged:e24c8195-c437-4310-8a5c-341bb8593462 for instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 on hv-cinder-83699 May 11 09:51:53.452317 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-ddac9f18-fefa-4bbf-8414-7e05a0237e01 req-f40eeb30-01c8-4c5f-ba11-2be1bef71238 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.490429 May 11 09:51:53.453019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 29/64] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:53.528416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-70e9a75e-0a51-4d9b-ace6-4dc5acc8a819 req-5e9d6559-8b73-4ab5-ae4f-4a442852040c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:53.557476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-70e9a75e-0a51-4d9b-ace6-4dc5acc8a819 req-5e9d6559-8b73-4ab5-ae4f-4a442852040c service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.570972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-70e9a75e-0a51-4d9b-ace6-4dc5acc8a819 req-5e9d6559-8b73-4ab5-ae4f-4a442852040c service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.608029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-70e9a75e-0a51-4d9b-ace6-4dc5acc8a819 req-5e9d6559-8b73-4ab5-ae4f-4a442852040c service nova] Creating event network-changed:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:51:53.614838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-70e9a75e-0a51-4d9b-ace6-4dc5acc8a819 req-5e9d6559-8b73-4ab5-ae4f-4a442852040c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137258 May 11 09:51:53.623545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 30/65] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:53.641805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:53.642557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:53.660922 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.664655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.671564 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.672322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.727014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:53.739982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d2715cb7-ee4f-47cd-92d3-86fff7d62b4e tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.513183 May 11 09:51:53.743986 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 36/66] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:53 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:53.797722 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:53.802665 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:53.828460 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.828917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.829708 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.830146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.856252 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:53.866419 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-92fa4f60-f228-460e-b1a4-f6f0c11926a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1279 microversion: 2.1 time: 0.240361 May 11 09:51:53.868138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 31/67] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:53 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:53.909113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:53.910079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:53.919995 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.920920 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:53.921835 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:53.922509 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.051590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:54.065669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-380d196a-f482-43d2-82bd-b532ef687c2e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1233 microversion: 2.1 time: 0.314270 May 11 09:51:54.068275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 37/68] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:53 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1233 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:54.485584 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:54.509988 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:54.511296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:54.512461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-14bf3acd-e6c0-4a1b-905f-287462219b5f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1407 microversion: 2.20 time: 0.607894 May 11 09:51:54.516796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 32/69] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:53 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1407 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:54.691909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-99723283-7184-4528-b7df-6ea72dc8ea41 req-a09c2675-7ee8-4070-a1dd-98e3b7e75ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e", "tag": "cb7c958a-6b81-40de-807f-f4b25b2a1457"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:54.728876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-99723283-7184-4528-b7df-6ea72dc8ea41 req-a09c2675-7ee8-4070-a1dd-98e3b7e75ab1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.729738 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-99723283-7184-4528-b7df-6ea72dc8ea41 req-a09c2675-7ee8-4070-a1dd-98e3b7e75ab1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.759654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:54.760287 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:54.768006 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.768465 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.769257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.771802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.787851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-99723283-7184-4528-b7df-6ea72dc8ea41 req-a09c2675-7ee8-4070-a1dd-98e3b7e75ab1 service nova] Creating event network-changed:cb7c958a-6b81-40de-807f-f4b25b2a1457 for instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e on hv-cinder-83699 May 11 09:51:54.790012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-99723283-7184-4528-b7df-6ea72dc8ea41 req-a09c2675-7ee8-4070-a1dd-98e3b7e75ab1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 11 09:51:54.793654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.795522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.798928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.799894 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.827038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.compute.rpcapi [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 11 09:51:54.828222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] Releasing lock "compute-rpcapi-router" {{(pid=123393) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 11 09:51:54.862374 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2812d6b2-b8c8-466f-b5b5-4f1e4dcc2a9a None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.256755 May 11 09:51:54.863111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 38/70] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:54.884288 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:54.885130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:54.896325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.897154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:54.898506 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:54.899041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:55.151378 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:55.158836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f87e49e4-0619-4b37-a5d6-7d30754700a7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.279085 May 11 09:51:55.169825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 39/71] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:54 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:55.177154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:55.182843 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:55.190668 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:55.191595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:55.192561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:55.193628 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:55.321858 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:55.330792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ec400c6f-8604-496e-b57e-8db68757724d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1295 microversion: 2.1 time: 0.158282 May 11 09:51:55.333875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 40/72] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:55 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1295 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:55.531118 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:55.531752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:55.539897 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:55.540351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:55.541177 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:55.541553 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:55.614758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:55.625647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eb52a199-0241-4009-ac22-ceaf6baed3bc tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.869762 May 11 09:51:55.626344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 33/73] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:54 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:56.007009 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:56.022514 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:56.024643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:56.027507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-aef82e91-70a9-4544-809a-75ec8cef21ef tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1407 microversion: 2.20 time: 0.499372 May 11 09:51:56.032328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 41/74] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:55 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1407 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:51:56.177885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:56.178667 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:56.191507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.193682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.194504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.194947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.361655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:56.363520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:56.380259 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.381110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.386077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.387073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.586952 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:56.600285 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5545b616-a960-4f0d-9d3d-137304fea8cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1295 microversion: 2.1 time: 0.252506 May 11 09:51:56.602581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 42/75] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:56 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1295 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:56.663463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:56.665643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:56.684327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.684781 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.694330 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:56.695078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:56.846220 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:56.854661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-56597e9f-b654-459d-a0ba-a6e851707141 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.682761 May 11 09:51:56.866401 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 34/76] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:56 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:57.048022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:57.048638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:57.057936 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.058392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.063170 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.063618 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.172093 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:57.190496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6e744300-b14e-4ad3-a45b-f637450d818a tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1314 microversion: 2.1 time: 0.547871 May 11 09:51:57.201551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 43/77] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:56 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:57.211036 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-b231072f-af25-41ab-871b-75dc49a89319 req-b2a7f514-aca7-4a4c-bbf9-3efa2970f9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a9cc23-65c2-44b7-82fd-3231b125d573", "tag": "97f449d2-6543-4043-95ca-0c159dc1eb8f"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:57.235774 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b231072f-af25-41ab-871b-75dc49a89319 req-b2a7f514-aca7-4a4c-bbf9-3efa2970f9b1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.241127 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b231072f-af25-41ab-871b-75dc49a89319 req-b2a7f514-aca7-4a4c-bbf9-3efa2970f9b1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.267399 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-b231072f-af25-41ab-871b-75dc49a89319 req-b2a7f514-aca7-4a4c-bbf9-3efa2970f9b1 service nova] Creating event network-changed:97f449d2-6543-4043-95ca-0c159dc1eb8f for instance 12a9cc23-65c2-44b7-82fd-3231b125d573 on hv-cinder-83699 May 11 09:51:57.282709 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-b231072f-af25-41ab-871b-75dc49a89319 req-b2a7f514-aca7-4a4c-bbf9-3efa2970f9b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087094 May 11 09:51:57.291248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 44/78] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:51:57.607655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:57.622265 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:57.623877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:57.639284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:57.639284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:57.640490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-31cafc84-ff3f-4720-b6ed-c340598cbc60 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1407 microversion: 2.20 time: 0.597373 May 11 09:51:57.652052 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.653137 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.673297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.673751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.675155 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 35/79] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:57 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1407 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:51:57.872212 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:57.875177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:57.882151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.882796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:57.883766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:57.884349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:58.017366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:58.024938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e148d280-9294-4672-a261-90efaf53f28e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.407909 May 11 09:51:58.025521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 45/80] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:57 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:58.069357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:58.078439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25e05215-6b84-4f4b-87a1-0e310d964192 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.209990 May 11 09:51:58.079025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 36/81] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:57 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:58.211313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:58.212924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:58.220431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:58.221476 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:58.222891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:58.223470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:58.392862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-de7dba16-57b9-4225-b17b-0c57a5ed86b4 req-8670728b-dc46-47c6-b757-2246c54a4408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "name": "network-vif-plugged", "status": "completed", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:51:58.422965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-de7dba16-57b9-4225-b17b-0c57a5ed86b4 req-8670728b-dc46-47c6-b757-2246c54a4408 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:58.425415 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-de7dba16-57b9-4225-b17b-0c57a5ed86b4 req-8670728b-dc46-47c6-b757-2246c54a4408 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:58.465868 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-de7dba16-57b9-4225-b17b-0c57a5ed86b4 req-8670728b-dc46-47c6-b757-2246c54a4408 service nova] Creating event network-vif-plugged:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:51:58.488154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-de7dba16-57b9-4225-b17b-0c57a5ed86b4 req-8670728b-dc46-47c6-b757-2246c54a4408 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098860 May 11 09:51:58.490962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 37/82] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:51:58.491104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:58.525622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ea350215-a779-46ab-ab33-1578f19380ee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1501 microversion: 2.1 time: 0.312449 May 11 09:51:58.525622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 46/83] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:58 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1501 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:51:58.662845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:58.664302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:58.678658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:58.679466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:58.680303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:58.680748 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:59.042836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:59.044132 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:59.050355 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:59.050802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:59.051569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:59.052191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:59.260745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:59.274238 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cfcd7f8a-e00d-4361-b229-b26cd951a81a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.235654 May 11 09:51:59.275671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 47/84] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:59 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:51:59.282848 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:51:59.284195 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:51:59.291864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:59.292528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:59.294264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:51:59.294972 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:51:59.357503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:59.365814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:59.368020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:59.369586 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b4921102-defc-4df0-8736-dcc2f8920041 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1407 microversion: 2.20 time: 0.715039 May 11 09:51:59.373156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 38/85] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:51:58 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1407 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:51:59.544543 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:51:59.564384 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6aa8833f-c6f2-49b5-af3f-0c084b24c8d7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.287426 May 11 09:51:59.576216 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 48/86] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:51:59 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:00.118751 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dac0b87c-00f2-449b-99e5-d342197d42db"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:00.120177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:00.130155 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.130759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.131682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.132301 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.292633 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:00.294655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:00.307344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.318569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.322791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.323832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.567605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:00.576779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7fe70e90-d8e3-4810-b4d9-f49dd99295eb tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.288670 May 11 09:52:00.585793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 49/87] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:00 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:00.595480 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-4bd9005e-6397-42f6-9017-5767e0287de9 req-60764275-f928-4353-bcdf-201329725826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b269761-570a-4253-866d-f35c6b8002bb", "tag": "df2abd79-668f-498d-a57f-5e550ea880ea"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:00.619521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4bd9005e-6397-42f6-9017-5767e0287de9 req-60764275-f928-4353-bcdf-201329725826 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.620371 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4bd9005e-6397-42f6-9017-5767e0287de9 req-60764275-f928-4353-bcdf-201329725826 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.634429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-4bd9005e-6397-42f6-9017-5767e0287de9 req-60764275-f928-4353-bcdf-201329725826 service nova] Creating event network-changed:df2abd79-668f-498d-a57f-5e550ea880ea for instance 4b269761-570a-4253-866d-f35c6b8002bb on hv-cinder-83699 May 11 09:52:00.640779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-4bd9005e-6397-42f6-9017-5767e0287de9 req-60764275-f928-4353-bcdf-201329725826 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052736 May 11 09:52:00.641845 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 50/88] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:00.652092 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:00.653037 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:00.660297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.660752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.661523 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.661955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.822797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:00.831221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:00.833800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:00.835047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f39bc82d-e4b0-425c-a0fe-3abf85deca95 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1598 microversion: 2.20 time: 0.192003 May 11 09:52:00.836499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 51/89] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:52:00 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:52:00.842967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:00.844318 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:00.851289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.852689 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:00.854427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:00.855226 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:01.280851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:01.288934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-73f564c4-1d21-40dd-95ba-a902e748d1aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.450958 May 11 09:52:01.300899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 52/90] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:00 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:01.316063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:01.316786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:01.329453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:01.332248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:01.333214 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:01.334368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:01.426824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f1c9699f-b738-4f64-80fe-857c869e3684 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "POST /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.312378 May 11 09:52:01.439854 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 39/91] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:52:00 2022] POST /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8/os-volume_attachments => generated 194 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:01.573398 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3a9f37c3-399b-43de-9cfa-a2c1c95d874f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.270572 May 11 09:52:01.573989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 53/92] 10.222.0.44 () {60 vars in 1315 bytes} [Wed May 11 09:52:01 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-interface => generated 284 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:52:01.601708 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:01.603085 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:01.616766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:01.618099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:01.621057 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:01.621657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:02.307341 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:02.308022 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:02.322499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:02.324592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:02.333054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:02.333885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:02.800307 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:02.808736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a46e35d5-a73b-4533-be19-3ecaef0edbae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 1.211694 May 11 09:52:02.811545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 40/93] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:01 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:02.969236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-89c18a55-4b7a-4dae-b86b-a80552064524 req-216144df-aa73-4233-a0dc-4ac251e9222f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e", "name": "network-vif-plugged", "status": "completed", "tag": "cb7c958a-6b81-40de-807f-f4b25b2a1457"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:02.969697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:02.977372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fbbf26c9-3789-430c-81bf-dfec2cb34790 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.674798 May 11 09:52:02.983504 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 54/94] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:02 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:02.996287 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-89c18a55-4b7a-4dae-b86b-a80552064524 req-216144df-aa73-4233-a0dc-4ac251e9222f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:02.996753 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-89c18a55-4b7a-4dae-b86b-a80552064524 req-216144df-aa73-4233-a0dc-4ac251e9222f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:03.037544 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-89c18a55-4b7a-4dae-b86b-a80552064524 req-216144df-aa73-4233-a0dc-4ac251e9222f service nova] Creating event network-vif-plugged:cb7c958a-6b81-40de-807f-f4b25b2a1457 for instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e on hv-cinder-83699 May 11 09:52:03.053578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-89c18a55-4b7a-4dae-b86b-a80552064524 req-216144df-aa73-4233-a0dc-4ac251e9222f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088191 May 11 09:52:03.055869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 41/95] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:52:03.831379 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:03.832235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:03.847005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:03.847733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:03.850099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:03.851531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:04.004715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:04.006418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:04.016419 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:04.017118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:04.018381 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:04.019029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:04.125493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:04.132943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-60306772-b906-41b9-9684-2926e72907e2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.306441 May 11 09:52:04.133527 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 55/96] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:03 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:04.226155 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-7a70c365-6ea3-420e-921f-2c58574556ab req-7a3717b9-5ce3-451a-9b84-e283849047db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:04.237133 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7a70c365-6ea3-420e-921f-2c58574556ab req-7a3717b9-5ce3-451a-9b84-e283849047db service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:04.237828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7a70c365-6ea3-420e-921f-2c58574556ab req-7a3717b9-5ce3-451a-9b84-e283849047db service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:04.253076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-7a70c365-6ea3-420e-921f-2c58574556ab req-7a3717b9-5ce3-451a-9b84-e283849047db service nova] Creating event network-changed:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:52:04.260882 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-7a70c365-6ea3-420e-921f-2c58574556ab req-7a3717b9-5ce3-451a-9b84-e283849047db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037335 May 11 09:52:04.267525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 56/97] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:52:04.314460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:04.322499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a5bf865-e59c-4fea-a078-72d96b2689a2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.323496 May 11 09:52:04.323202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 42/98] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:03 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:05.079740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-d26bc5ca-3a3d-406c-ad1a-7aee80efc7cf req-20402f60-6396-42b9-afd6-de7e83d24fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a9cc23-65c2-44b7-82fd-3231b125d573", "name": "network-vif-plugged", "status": "completed", "tag": "97f449d2-6543-4043-95ca-0c159dc1eb8f"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:05.095112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d26bc5ca-3a3d-406c-ad1a-7aee80efc7cf req-20402f60-6396-42b9-afd6-de7e83d24fb6 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:05.095563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d26bc5ca-3a3d-406c-ad1a-7aee80efc7cf req-20402f60-6396-42b9-afd6-de7e83d24fb6 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:05.116701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-d26bc5ca-3a3d-406c-ad1a-7aee80efc7cf req-20402f60-6396-42b9-afd6-de7e83d24fb6 service nova] Creating event network-vif-plugged:97f449d2-6543-4043-95ca-0c159dc1eb8f for instance 12a9cc23-65c2-44b7-82fd-3231b125d573 on hv-cinder-83699 May 11 09:52:05.124739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-d26bc5ca-3a3d-406c-ad1a-7aee80efc7cf req-20402f60-6396-42b9-afd6-de7e83d24fb6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050426 May 11 09:52:05.135248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 57/99] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:05.150975 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:05.151769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:05.161282 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:05.161833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:05.162949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:05.163580 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:05.352280 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:05.353807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:05.396925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:05.399754 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:05.400901 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:05.402980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:05.644088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:05.653208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:05.655320 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3c9fb8d3-8909-4fd2-b073-41a954f3c435 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.508937 May 11 09:52:05.656177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 43/100] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:05 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:05.662497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-71fdcbe0-ba92-4bb4-be1a-57ef7675dcdc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.326592 May 11 09:52:05.663279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 58/101] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:05 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:06.673535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:06.674277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:06.681793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:06.682504 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:06.697800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:06.698253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:06.704756 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:06.705201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:06.706596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:06.707766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:06.709795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:06.710544 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:06.898335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:06.908872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6c41e757-3bfa-4baf-9fbf-2661df0f9e1f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1321 microversion: 2.1 time: 0.232141 May 11 09:52:06.909934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:06.912678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 59/102] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:06 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:06.921926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a69e46d3-82ee-459f-95df-e5fc2c9e614a tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.253031 May 11 09:52:06.922510 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 44/103] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:06 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:07.930272 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:07.930995 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:07.939534 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:07.940521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:07.945962 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:07.946802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:07.947562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:07.947892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:07.948149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:07.948633 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:07.948766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:07.949204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.105562 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:08.115090 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8578bb58-a145-4182-90d1-52509b3791e3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1515 microversion: 2.1 time: 0.189813 May 11 09:52:08.129348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 60/104] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:07 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1515 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:08.140506 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:08.141661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:08.149338 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:08.160562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e50fc38f-6faa-4c61-821a-3903a8b98c0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.225401 May 11 09:52:08.163199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 45/105] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:07 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:08.165208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:08.165848 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.166778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:08.167361 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.207679 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'flavor' on Instance uuid 12a9cc23-65c2-44b7-82fd-3231b125d573 {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:52:08.353528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4b51e46c-cd7c-49cc-a0a8-e2fb5d4d4ea1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573/action" status: 200 len: 32 microversion: 2.1 time: 0.219433 May 11 09:52:08.354146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 61/106] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:52:08 2022] POST /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:52:08.363225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:08.363911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:08.369661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:08.370112 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.370895 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:08.371295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.590308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:08.614865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc5611f8-8ad8-4c56-9112-879ca30c72f2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.255449 May 11 09:52:08.615467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 46/107] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:08 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:08.694534 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-d50a62f8-d781-4657-9a53-6c76fb37c630 req-2dfecc49-d9f7-4abc-a9a5-d1f0a1e7bdb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b269761-570a-4253-866d-f35c6b8002bb", "name": "network-vif-plugged", "status": "completed", "tag": "df2abd79-668f-498d-a57f-5e550ea880ea"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:08.703797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d50a62f8-d781-4657-9a53-6c76fb37c630 req-2dfecc49-d9f7-4abc-a9a5-d1f0a1e7bdb8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:08.704517 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d50a62f8-d781-4657-9a53-6c76fb37c630 req-2dfecc49-d9f7-4abc-a9a5-d1f0a1e7bdb8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:08.718975 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-d50a62f8-d781-4657-9a53-6c76fb37c630 req-2dfecc49-d9f7-4abc-a9a5-d1f0a1e7bdb8 service nova] Creating event network-vif-plugged:df2abd79-668f-498d-a57f-5e550ea880ea for instance 4b269761-570a-4253-866d-f35c6b8002bb on hv-cinder-83699 May 11 09:52:08.724519 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-d50a62f8-d781-4657-9a53-6c76fb37c630 req-2dfecc49-d9f7-4abc-a9a5-d1f0a1e7bdb8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 May 11 09:52:08.725166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 62/108] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:09.179437 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:09.180243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:09.187623 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:09.188351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:09.189351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:09.190054 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:09.343058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:09.350283 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-013e1c7e-c230-4ea2-ba42-fbcf2ba909af tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.174708 May 11 09:52:09.350850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 47/109] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:09 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:09.636646 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:09.638611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:09.647486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:09.648270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:09.649585 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:09.650571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:09.799346 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:09.808041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9e96ab6a-a712-4b2d-81a1-682dd2b98cd2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.177925 May 11 09:52:09.808753 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 63/110] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:09 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:10.367362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:10.368016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:10.374926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:10.375373 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:10.376173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:10.376602 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:10.531587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:10.539190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24db5369-7bf8-4fb6-9369-e3a1f149e596 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.176422 May 11 09:52:10.540843 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 48/111] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:10 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:10.825257 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:10.825905 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:10.831746 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:10.832349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:10.833185 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:10.833629 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:10.966196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:10.974269 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-926e1352-badf-47db-acef-c4fc018b8561 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.153248 May 11 09:52:10.974840 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 64/112] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:10 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:11.559030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:11.559642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:11.566472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:11.566939 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:11.567707 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:11.568157 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:11.697931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:11.706350 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf096646-3da2-4f7d-99b9-603631493f20 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.153661 May 11 09:52:11.706924 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 49/113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:11 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:11.991561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:11.992138 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:11.998303 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:11.998756 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:12.000192 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:12.000705 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:12.154904 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:12.163409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1d94700c-6bca-4c78-a3ae-eab221430794 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.175794 May 11 09:52:12.164934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 65/114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:11 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:12.724444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:12.725184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:12.757741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:12.758369 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:12.759328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:12.759883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.181608 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:13.183282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:13.187907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:13.189697 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6c170e6b-e995-40b6-91e7-013380d97a7b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.470480 May 11 09:52:13.190258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 50/115] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:12 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:13.204054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.204503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.205283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.205711 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.340927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:13.349084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1defa64f-45c5-4094-9e26-3b3ea4c311f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.169552 May 11 09:52:13.349652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 66/116] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:13 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:13.532980 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:13.533538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:13.539965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.540474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.541303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.541798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.567620 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:52:13.662412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ed6d4abe-6f35-4343-9ab3-05302a633252 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 204 len: 0 microversion: 2.1 time: 0.133021 May 11 09:52:13.663284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 51/117] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:52:13 2022] DELETE /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:52:13.671529 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:13.672246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:13.678026 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.678563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.679393 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:13.680273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:13.813834 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:13.821864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c32c2b9e-ebe9-4a2c-8007-1249e45fffab tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.154629 May 11 09:52:13.822434 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 67/118] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:13 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:14.207709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:14.208593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:14.215820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.216298 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.217804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.218514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.346467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:14.356140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9ad8b68-e095-439c-89f7-5841279105aa tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.152702 May 11 09:52:14.356731 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 52/119] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:14 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:14.374383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:14.374988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:14.381165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.381805 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.382730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.383314 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.527803 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:14.535828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0d5ebba3-8dcc-40dc-98b0-f92412640529 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.166364 May 11 09:52:14.536467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 68/120] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:14 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:14.839003 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:14.839603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:14.845477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.845920 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.846673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:14.847135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:14.978644 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:14.987662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d94db6bb-ed74-4d0e-9fe3-ab9568bc547d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.152327 May 11 09:52:14.988704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 53/121] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:14 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:15.380858 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:15.381416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:15.388477 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:15.388925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:15.390040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:15.390621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:15.535354 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:15.543300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-33b21348-f9fb-48ae-9d16-03ad2852596c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.166302 May 11 09:52:15.544766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 69/122] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:15 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:15.558514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:15.559127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:15.565815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:15.566261 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:15.567325 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:15.567451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:15.704299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:15.712159 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-00e8ff00-3ef6-43f2-b258-3214cccb0da4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.157546 May 11 09:52:15.712728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 54/123] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:15 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:16.006102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:16.006868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:16.013359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.013893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.014729 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.015271 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.142846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:16.150757 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c7bd35f8-f94a-4383-88fa-991df1f772af tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.149569 May 11 09:52:16.151409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 70/124] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:16 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:16.561159 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:16.561787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:16.567965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.568402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.569403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.569830 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.695716 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:16.702921 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3e1411b1-ffff-412e-a2a9-11f7210bb598 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.146166 May 11 09:52:16.703480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 55/125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:16 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:16.728952 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:16.729740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:16.735956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.736397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.737145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:16.737569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:16.872941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:16.880720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1ef3baf5-8af3-453e-a4a1-c81e11480c99 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.155457 May 11 09:52:16.881382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 71/126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:16 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:17.167654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:17.168289 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:17.175260 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.175730 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:17.176785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.177217 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:17.319151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:17.327461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e5d6aff-e2b2-4591-917e-65c47dcdc437 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.164211 May 11 09:52:17.328063 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 56/127] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:17 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:17.721272 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:17.722250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:17.729534 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.730191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:17.731050 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.731477 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:17.866428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:17.874545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-281fc0dd-f457-44a2-86d9-7e281ed75dcc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1362 microversion: 2.1 time: 0.158347 May 11 09:52:17.875121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 72/128] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:17 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:17.897991 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:17.898700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:17.905181 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.905625 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:17.906505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:17.906931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:18.051287 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:18.060659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-22d66518-3bab-42fe-bb25-6bb333aa89f3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.166301 May 11 09:52:18.061245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 57/129] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:17 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:18.348062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:18.348668 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:18.355837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:18.356276 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:18.357040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:18.357463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:18.503826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:18.518076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f7619bab-159b-419a-9e18-ba31ade9c952 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.176267 May 11 09:52:18.521361 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 73/130] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:18 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:18.892883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:18.893637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:18.900078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:18.901776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:18.902823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:18.903460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.080544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:19.081588 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:19.104522 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:19.108134 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.109638 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.111611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.115384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-da821858-fa6b-43fa-a56d-20e6dad8ec94 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1547 microversion: 2.1 time: 0.225236 May 11 09:52:19.115384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 58/131] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:18 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1547 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:19.122031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.138341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:19.140793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:19.151358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.152037 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.153432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.154016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.274464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4261fb8f-6669-4b36-97c0-78a74f202097 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144017 May 11 09:52:19.275057 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 59/132] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:52:19 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:19.358407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:19.365742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c3f6bcb1-8868-4b3d-bcdd-747f4db2d2a5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.291135 May 11 09:52:19.366851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 74/133] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:19 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:19.538207 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:19.538821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:19.545613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.546260 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.547191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:19.547798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:19.891415 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:19.906990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a18cc585-20b9-404d-98ba-9f0b1760eed3 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1553 microversion: 2.1 time: 0.372336 May 11 09:52:19.909078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 60/134] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:19 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:20.335013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-2137e868-e4bc-4dfb-ae26-22500e2e0e52 req-076455f6-f7da-4260-88a7-6af6c0d3da5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab5eaf94-60a1-482b-bcae-fefec3fe22c8", "name": "network-vif-deleted", "tag": "e24c8195-c437-4310-8a5c-341bb8593462"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:20.359078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-2137e868-e4bc-4dfb-ae26-22500e2e0e52 req-076455f6-f7da-4260-88a7-6af6c0d3da5e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.359546 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-2137e868-e4bc-4dfb-ae26-22500e2e0e52 req-076455f6-f7da-4260-88a7-6af6c0d3da5e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.383320 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:20.384033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:20.395782 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-2137e868-e4bc-4dfb-ae26-22500e2e0e52 req-076455f6-f7da-4260-88a7-6af6c0d3da5e service nova] Creating event network-vif-deleted:e24c8195-c437-4310-8a5c-341bb8593462 for instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 on hv-cinder-83699 May 11 09:52:20.403669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.404329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.405266 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.405876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.416367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-2137e868-e4bc-4dfb-ae26-22500e2e0e52 req-076455f6-f7da-4260-88a7-6af6c0d3da5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085292 May 11 09:52:20.418845 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 75/135] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:20.573324 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:20.581634 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-af280d0c-dff8-4eed-a986-3f514ccfd641 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.203175 May 11 09:52:20.582213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 61/136] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:20 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:20.863223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-aeb5e613-50c9-46ce-9147-edd8333555e2 req-468d2003-972a-4cf6-be58-e05689c811e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b269761-570a-4253-866d-f35c6b8002bb", "tag": "df2abd79-668f-498d-a57f-5e550ea880ea"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:20.878440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-aeb5e613-50c9-46ce-9147-edd8333555e2 req-468d2003-972a-4cf6-be58-e05689c811e4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.878903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-aeb5e613-50c9-46ce-9147-edd8333555e2 req-468d2003-972a-4cf6-be58-e05689c811e4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.893956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-aeb5e613-50c9-46ce-9147-edd8333555e2 req-468d2003-972a-4cf6-be58-e05689c811e4 service nova] Creating event network-changed:df2abd79-668f-498d-a57f-5e550ea880ea for instance 4b269761-570a-4253-866d-f35c6b8002bb on hv-cinder-83699 May 11 09:52:20.899968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-aeb5e613-50c9-46ce-9147-edd8333555e2 req-468d2003-972a-4cf6-be58-e05689c811e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041072 May 11 09:52:20.900561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 76/137] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:20.927267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:20.927994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:20.936992 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.937621 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.938559 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.938998 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.982701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:20.983166 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:20.984801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lazy-loading 'fault' on Instance uuid ab5eaf94-60a1-482b-bcae-fefec3fe22c8 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:52:21.043126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e725fa4d9cc46c1b9578109d1daa9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '749504c9ac8140ff9436f595b73afbb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:21.054282 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fc8067d8-dd42-4a39-8838-e0f2755f8394 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 200 len: 1350 microversion: 2.1 time: 0.131970 May 11 09:52:21.065883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 62/138] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:20 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 1350 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:21.599724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:21.600892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:21.616119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:21.618716 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:21.622946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:21.624312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:21.979582 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:21.989543 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-da7e2f8f-7f53-4ce0-ae27-caed8e511fd9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.394385 May 11 09:52:22.000281 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 77/139] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:21 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:22.079417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:22.079417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:22.084146 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:22.085090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:22.085388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:22.085840 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:22.127202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] HTTP exception thrown: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Request method failure captured: May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 HTTP/1.1 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cYap4z2yaxlYPPpYoJZ6xUrcZDeo8_FBtXPYmiRIuMZfts7ES6v1d1vY_NF-ZI7RhgxpElWhTbAmk7L4htF6ippYcUgFeS8aR0ioPsanR8r-r1eWjguj8LHts-aLnK8UdTAQyxwnzTmXB4TnS1xunfZ4105haVI_TbBPvsyJk2gqo May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:52:22.139766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_749504c9ac8140ff9436f595b73afbb1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 5e725fa4d9cc46c1b9578109d1daa9b2 May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.141535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'ab5eaf94-60a1-482b-bcae-fefec3fe22c8'} May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:52:22.142250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.143378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:22.146981 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Returning 404 to user: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:52:22.146981 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7389a597-dc06-46e0-9d03-9bcf366e959b tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 404 len: 111 microversion: 2.1 time: 0.074112 May 11 09:52:22.146981 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 63/140] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:22 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:52:22.342336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:22.343541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:22.355777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:22.356846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:22.357796 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:22.358379 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:22.376812 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] HTTP exception thrown: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Request method failure captured: May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8/os-volume_attachments HTTP/1.1 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cYap4z2yaxlYPPpYoJZ6xUrcZDeo8_FBtXPYmiRIuMZfts7ES6v1d1vY_NF-ZI7RhgxpElWhTbAmk7L4htF6ippYcUgFeS8aR0ioPsanR8r-r1eWjguj8LHts-aLnK8UdTAQyxwnzTmXB4TnS1xunfZ4105haVI_TbBPvsyJk2gqo May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:52:22.381278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_749504c9ac8140ff9436f595b73afbb1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 5e725fa4d9cc46c1b9578109d1daa9b2 May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.382577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'server_id': 'ab5eaf94-60a1-482b-bcae-fefec3fe22c8'} May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:52:22.384893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:22.386373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:22.389386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Returning 404 to user: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:52:22.389386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-53028b47-b0df-4d92-abfb-e6ca86d7feee tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045486 May 11 09:52:22.389815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 78/141] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:52:22 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:52:23.009369 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:23.010223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:23.020905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.023419 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.028735 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.029343 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.345185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:23.356092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-64bb08a4-9e01-4943-bbd5-d3860aee1f1d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.352352 May 11 09:52:23.366305 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 64/142] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:23 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:23.669579 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:23.670106 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:23.681659 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.691274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.692594 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.693808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.726577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] HTTP exception thrown: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Request method failure captured: May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 HTTP/1.1 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cYap4z2yaxlYPPpYoJZ6xUrcZDeo8_FBtXPYmiRIuMZfts7ES6v1d1vY_NF-ZI7RhgxpElWhTbAmk7L4htF6ippYcUgFeS8aR0ioPsanR8r-r1eWjguj8LHts-aLnK8UdTAQyxwnzTmXB4TnS1xunfZ4105haVI_TbBPvsyJk2gqo May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:52:23.730054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_749504c9ac8140ff9436f595b73afbb1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 5e725fa4d9cc46c1b9578109d1daa9b2 May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.731481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'ab5eaf94-60a1-482b-bcae-fefec3fe22c8'} May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:52:23.732367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.733657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:23.736486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Returning 404 to user: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:52:23.738136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b139f71e-c24a-4d42-8550-58082c103de8 tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 404 len: 111 microversion: 2.1 time: 0.074059 May 11 09:52:23.739171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 79/143] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:52:23 2022] DELETE /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:52:23.748856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:23.749576 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] [instance: ab5eaf94-60a1-482b-bcae-fefec3fe22c8] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:23.756513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.758062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.759017 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:23.759621 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:23.778638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] HTTP exception thrown: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Request method failure captured: May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 HTTP/1.1 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cYap4z2yaxlYPPpYoJZ6xUrcZDeo8_FBtXPYmiRIuMZfts7ES6v1d1vY_NF-ZI7RhgxpElWhTbAmk7L4htF6ippYcUgFeS8aR0ioPsanR8r-r1eWjguj8LHts-aLnK8UdTAQyxwnzTmXB4TnS1xunfZ4105haVI_TbBPvsyJk2gqo May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:52:23.781040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_749504c9ac8140ff9436f595b73afbb1", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/749504c9ac8140ff9436f595b73afbb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 749504c9ac8140ff9436f595b73afbb1 May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-DeleteServersTestJSON-2016772116 May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 5e725fa4d9cc46c1b9578109d1daa9b2 May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-DeleteServersTestJSON-2016772116-project May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.782702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'ab5eaf94-60a1-482b-bcae-fefec3fe22c8'} May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:52:23.783563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. May 11 09:52:23.785082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:52:23.787500 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] Returning 404 to user: Instance ab5eaf94-60a1-482b-bcae-fefec3fe22c8 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:52:23.788930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ad94b81-f75f-4743-9dfd-ea55272f6b8d tempest-DeleteServersTestJSON-2016772116 tempest-DeleteServersTestJSON-2016772116-project] 10.222.0.44 "GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8" status: 404 len: 111 microversion: 2.1 time: 0.045282 May 11 09:52:23.802363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 65/144] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:23 2022] GET /compute/v2.1/servers/ab5eaf94-60a1-482b-bcae-fefec3fe22c8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:52:24.375096 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:24.375784 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:24.386581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:24.387045 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:24.387864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:24.388292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:24.638598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:24.657891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-958ff2e8-61a7-4003-8198-ad392c628ff2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.287805 May 11 09:52:24.669503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 80/145] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:24 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:25.679270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:25.679952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:25.687650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:25.688367 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:25.689530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:25.690219 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:25.882738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:25.893592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11e32c4c-bb34-40d7-b273-3069c6a285cf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.221489 May 11 09:52:25.896760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 66/146] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:25 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:26.395311 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f1d90eeb-c3b7-4213-905c-b9bfe20f80c9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Action: 'create', calling method: .version_select at 0x7f8bcd69e700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-384153223", "metadata": {"Type": "work"}}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:26.701398 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f1d90eeb-c3b7-4213-905c-b9bfe20f80c9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.545960 May 11 09:52:26.702024 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 81/147] 10.222.0.44 () {60 vars in 1155 bytes} [Wed May 11 09:52:26 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 547 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 11 09:52:26.713452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50e19ca5-3b25-42bb-976b-633bf4874218 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd683160>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:26.761514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50e19ca5-3b25-42bb-976b-633bf4874218 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.051792 May 11 09:52:26.762092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 67/148] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:26 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:26.915407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:26.916033 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:26.922115 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:26.922558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:26.923317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:26.923770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:27.046717 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:27.054159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cd56bf9c-9723-40e6-b3d0-5d2f22928486 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.142589 May 11 09:52:27.054810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 82/149] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:26 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:27.774773 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e23bced7-7a4f-4b96-8a62-6ae7f8f2758e tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd6e5ca0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:27.820396 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e23bced7-7a4f-4b96-8a62-6ae7f8f2758e tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.050377 May 11 09:52:27.820993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 68/150] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:27 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:28.070917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:28.071519 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:28.077298 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:28.077735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:28.078481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:28.078903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:28.202912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:28.210196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-de4ef583-b36a-45d5-9b51-c1550364683e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.143819 May 11 09:52:28.210754 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 83/151] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:28 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:28.833952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5ee73a91-3b8c-436f-9a51-3b5a033964f7 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd6e5940>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:28.877640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5ee73a91-3b8c-436f-9a51-3b5a033964f7 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.049166 May 11 09:52:28.878183 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 69/152] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:28 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:29.226469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:29.227074 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:29.233036 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:29.233485 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:29.234240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:29.234669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:29.359443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:29.366571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-941fbb77-66a5-4820-86c5-429cb6c57aa5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.143879 May 11 09:52:29.367127 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 84/153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:29 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:29.890565 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d4a892fa-d188-43e3-b7b8-e64a222840cf tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd839160>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:29.936574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d4a892fa-d188-43e3-b7b8-e64a222840cf tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 353 microversion: 2.1 time: 0.050414 May 11 09:52:29.937171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 70/154] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:29 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:29.948292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a5769e6c-ffb5-4d85-9a0c-9c4b312654a9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd645790>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:29.995479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a5769e6c-ffb5-4d85-9a0c-9c4b312654a9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 353 microversion: 2.1 time: 0.050847 May 11 09:52:29.996084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 85/155] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:29 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:30.011710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d6f76e1f-dc4c-43da-a29c-a2d33e5e92d2 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd683310>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:30.076488 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d6f76e1f-dc4c-43da-a29c-a2d33e5e92d2 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 202 len: 0 microversion: 2.1 time: 0.068511 May 11 09:52:30.077127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 71/156] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:52:30 2022] DELETE /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:52:30.089990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e8b3cca-45aa-44f6-b435-befa864ef8e9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd645b80>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:30.135162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e8b3cca-45aa-44f6-b435-befa864ef8e9 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.049049 May 11 09:52:30.135742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 86/157] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:30 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:30.383261 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:30.383900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:30.390148 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:30.390588 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:30.391337 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:30.391803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:30.531429 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:30.539372 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d351d9ef-647f-4649-ae9d-36485013845f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.159673 May 11 09:52:30.539847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 72/158] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:30 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:31.147916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-bdff15bb-ef10-4403-86e4-44e06f380c15 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd694d30>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:31.192646 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-bdff15bb-ef10-4403-86e4-44e06f380c15 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.048600 May 11 09:52:31.193201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 87/159] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:31 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:31.554634 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:31.555273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:31.561791 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:31.562240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:31.563002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:31.563434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:31.690293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:31.697713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3073bada-100e-4d47-acf5-e3349eda0c4c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.146829 May 11 09:52:31.698277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 73/160] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:31 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:32.204812 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-719a7f1b-df83-48f8-96cf-058a3d4e1384 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd7f4700>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:32.392875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-719a7f1b-df83-48f8-96cf-058a3d4e1384 tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 200 len: 352 microversion: 2.1 time: 0.191823 May 11 09:52:32.393436 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 88/161] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:32 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 352 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:32.715018 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:32.715658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:32.722726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:32.723170 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:32.723993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:32.724428 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:32.861578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:32.869709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4d07597a-7e53-48a2-a4d9-5ef6624f7225 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.158476 May 11 09:52:32.870293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 74/162] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:32 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:33.404598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-46ca3c72-03f3-4dfe-8f07-38b295e49b2c tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Calling method '.version_select at 0x7f8bcd759a60>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:33.434053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-46ca3c72-03f3-4dfe-8f07-38b295e49b2c tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] HTTP exception thrown: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-46ca3c72-03f3-4dfe-8f07-38b295e49b2c tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Request method failure captured: May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe HTTP/1.1 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4daFh80nbnvjYUGrzFFkuW2mn6bpVoDg8eDA0Vik4n5_obcCN1hY4YxYlKSf5Y5kqHB9gwOghl0RpehDGndwQ5kqBQGjG_NjKbV58jCzdc8TwpG7D5aKDesYPzVo2zeeARc8dlTAwtU13N_jP0A0I5RPgxK8eU45ErOCO5ydjcw8VE May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 3af5ed43105348be88176964aa38c426 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesGetTestJSON-730204769 May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:52:33.436041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3af5ed43105348be88176964aa38c426"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3af5ed43105348be88176964aa38c426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3af5ed43105348be88176964aa38c426", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3af5ed43105348be88176964aa38c426"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesGetTestJSON-730204769 May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 3af5ed43105348be88176964aa38c426 May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesGetTestJSON-730204769 May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesGetTestJSON-730204769-project May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 4f9fc1fccaf74c239ce89138066c936a May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesGetTestJSON-730204769-project May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '546bf179-66df-4a11-af64-2865a9ff0ffe'} May 11 09:52:33.437433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. (HTTP 404) (Request-ID: req-fca2eac1-5f18-4c3b-b245-69412797ae17) May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:33.441537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi item = cinderclient( May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 11 09:52:33.443145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 11 09:52:33.445239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-46ca3c72-03f3-4dfe-8f07-38b295e49b2c tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] Returning 404 to user: Volume 546bf179-66df-4a11-af64-2865a9ff0ffe could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-46ca3c72-03f3-4dfe-8f07-38b295e49b2c tempest-VolumesGetTestJSON-730204769 tempest-VolumesGetTestJSON-730204769-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe" status: 404 len: 109 microversion: 2.1 time: 0.036824 May 11 09:52:33.446502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 89/163] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:52:33 2022] GET /compute/v2.1/os-volumes/546bf179-66df-4a11-af64-2865a9ff0ffe => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:52:33.887590 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:33.888518 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:33.895186 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:33.895635 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:33.896435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:33.896869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:34.112476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:34.121465 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1ef6bda9-52cd-471a-98b4-3b5c6533e9dd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.238449 May 11 09:52:34.122044 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 75/164] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:33 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:35.138924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:35.139548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:35.146604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:35.147063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:35.147968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:35.148403 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:35.294876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:35.303072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c77134ae-585e-4a05-ad05-0cabb7cd3ac8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.168318 May 11 09:52:35.304071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 90/165] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:35 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:36.322022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:36.323382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:36.330170 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:36.330693 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:36.331531 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:36.332625 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:36.566629 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:36.590574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7b54abe1-68ea-4b9f-9a5c-7844c695edad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.273141 May 11 09:52:36.592265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 76/166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:36 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:37.607256 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:37.607982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:37.621275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:37.622013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:37.622952 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:37.624107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:37.764702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:37.772418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5602a842-0c89-4c8d-9b94-767c33bf8a8d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.168933 May 11 09:52:37.773246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 91/167] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:37 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:38.323682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1313017820", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "networks": [{"uuid": "9f228208-8bca-4646-b7d5-db2ea2cdbac4"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:38.403758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] validate_networks() for [('9f228208-8bca-4646-b7d5-db2ea2cdbac4', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:52:38.789946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:38.791370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:38.800942 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:38.801820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:38.802856 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:38.803473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:38.814749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:52:38.815171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:52:38.815855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:52:38.816411 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:52:38.816988 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:52:38.827616 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:38.828520 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:38.836354 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:38.837184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:38.856944 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Getting quotas for project c5a4b0af04ce4c83b4720754165c938e. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:52:38.861618 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Getting quotas for user 6c3bda86f10c41bba122a6ff926d44f3 and project c5a4b0af04ce4c83b4720754165c938e. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:52:38.876173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:52:38.879032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:52:38.934761 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-79469c71-e7ca-4e11-a9e9-8aa05fbae0a2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615186 May 11 09:52:38.940259 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 77/168] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:52:38.945964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bad6f96d-2ba4-46dc-9cb6-551c58687324 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:38.946694 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bad6f96d-2ba4-46dc-9cb6-551c58687324 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:39.026687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:39.036641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1d9e732a-f706-4d2f-b157-6cecad879a1c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.250748 May 11 09:52:39.037229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bad6f96d-2ba4-46dc-9cb6-551c58687324 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:39.051564 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bad6f96d-2ba4-46dc-9cb6-551c58687324 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1214 microversion: 2.1 time: 0.108794 May 11 09:52:39.051564 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 78/169] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:38 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:39.052265 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 92/170] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:38 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:40.058952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:40.059570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:40.066506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:40.066956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:40.067751 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:40.068190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:40.069021 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:40.069636 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:40.076793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:40.077234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:40.078644 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:40.079220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:40.149080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:40.157206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-de0bbf64-d617-44a0-b8ac-711627d0bf9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1218 microversion: 2.1 time: 0.092560 May 11 09:52:40.158027 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 93/171] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:40 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:40.237114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:40.250509 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fdd53643-409f-47b0-8958-528a1286afe6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.195954 May 11 09:52:40.251167 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 79/172] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:40 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:41.180327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:41.180939 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:41.187328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:41.187802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:41.188574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:41.189009 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:41.253612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:41.261051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c60e3188-fb1e-4886-9e7c-985752901f61 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1218 microversion: 2.1 time: 0.084778 May 11 09:52:41.261611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 94/173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:41 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:41.268230 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:41.269026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:41.282653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:41.283184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:41.284111 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:41.284548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:41.420846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:41.428191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0d3c27e-ab46-4af9-8240-95f1c94a2aa4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.163725 May 11 09:52:41.429028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 80/174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:41 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:42.278688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:42.279355 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:42.285453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:42.285889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:42.286675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:42.287097 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:42.352752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:42.360012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9f39e6c2-e26b-4e2f-ba0d-302bca8b20c1 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1218 microversion: 2.1 time: 0.085757 May 11 09:52:42.369039 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 95/175] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:42 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:42.456540 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:42.457148 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:42.463449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:42.463935 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:42.464701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:42.465687 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:42.603306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:42.610755 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f36ac63b-d7df-4d7c-a596-a77f271ae09d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1521 microversion: 2.1 time: 0.168039 May 11 09:52:42.611319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 81/176] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:42 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:43.377080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:43.377691 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:43.384179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.384563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:43.385546 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.385982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:43.452425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:43.460533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-26ded635-8114-4a31-9975-ab9deb2e93e0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1266 microversion: 2.1 time: 0.086832 May 11 09:52:43.461219 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 96/177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:43 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:43.628757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:43.630341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:43.638821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.639543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:43.640419 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.640870 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:43.857865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:43.869760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7255f647-090f-4199-bf58-b7d24007a8fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1501 microversion: 2.1 time: 0.242999 May 11 09:52:43.870491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 82/178] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:43 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:43.891189 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:43.891921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:43.898490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.904102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:43.905081 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:43.905580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:44.067279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:44.082547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e2eaca06-ea44-4cb4-9e20-a6fe67847334 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1515 microversion: 2.1 time: 0.196406 May 11 09:52:44.083440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 97/179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:43 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:44.489932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:44.491233 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:44.500577 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:44.502591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:44.503413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:44.507596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:44.788131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:44.811130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3cbaf976-8992-47e1-b004-9ea53d5bfdb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.333333 May 11 09:52:44.812719 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 83/180] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:44 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:45.541259 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-88cf457e-4f96-4690-a228-a7bf8b94acec req-cfedd012-5eb5-4e66-ab67-784252bbba3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e", "tag": "7dec1140-d648-4f71-a31a-fad530c962ca"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:45.550679 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-88cf457e-4f96-4690-a228-a7bf8b94acec req-cfedd012-5eb5-4e66-ab67-784252bbba3f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.551426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-88cf457e-4f96-4690-a228-a7bf8b94acec req-cfedd012-5eb5-4e66-ab67-784252bbba3f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.579614 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-88cf457e-4f96-4690-a228-a7bf8b94acec req-cfedd012-5eb5-4e66-ab67-784252bbba3f service nova] Creating event network-changed:7dec1140-d648-4f71-a31a-fad530c962ca for instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e on hv-cinder-83699 May 11 09:52:45.587269 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-88cf457e-4f96-4690-a228-a7bf8b94acec req-cfedd012-5eb5-4e66-ab67-784252bbba3f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050568 May 11 09:52:45.589325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 98/181] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:52:45.706206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:45.707515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:45.715570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.716267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.717263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.717881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.753182 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'flavor' on Instance uuid 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:52:45.830370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:45.831063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:45.837080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.837524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.838342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.838770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.888157 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a423c7f-3434-421a-bc4a-90f8d6fe95b4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/action" status: 200 len: 32 microversion: 2.1 time: 0.185720 May 11 09:52:45.889068 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 84/182] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:52:45 2022] POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:52:45.898082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:45.899062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:45.905914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.907100 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.907188 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:45.907558 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:45.988808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:45.997825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2c98aaff-8f68-4ccc-8bb2-2879d5a12a78 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.171327 May 11 09:52:45.998582 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 99/183] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:45 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:46.051183 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:46.059418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c505196-a2d5-47d1-92c0-960837740a2f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.165388 May 11 09:52:46.060040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 85/184] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:45 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:47.014171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:47.015340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:47.021154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:47.021593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:47.022350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:47.022772 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:47.076796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:47.079467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:47.087201 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:47.089081 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:47.090348 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:47.091257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:47.191954 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:47.201828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2fc977f0-2b62-4a1e-977a-60bcb206058f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.191158 May 11 09:52:47.203132 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 100/185] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:47 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:47.294664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:47.302220 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f9205912-4b86-4684-b19c-98f4127fbec2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.229696 May 11 09:52:47.302783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 86/186] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:47 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:48.218332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:48.218943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:48.225594 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:48.226274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:48.227062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:48.227497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:48.319469 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:48.320256 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:48.334400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:48.334400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:48.334619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:48.335093 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:48.388440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:48.398851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f54e7f30-2b33-4f28-909d-ca3e7b78be89 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.184139 May 11 09:52:48.400150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 101/187] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:48 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:48.609701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:48.616957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f4de58fa-4409-48c6-9ee9-c4c5c185776b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.301210 May 11 09:52:48.617511 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 87/188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:48 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:49.416103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:49.416712 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:49.423286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:49.423751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:49.424630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:49.425330 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:49.558400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:49.567716 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b35d1688-7459-46a7-9bf3-af7dbb7742ce tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.155306 May 11 09:52:49.568280 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 102/189] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:49 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:49.634712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:49.635235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:49.641650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:49.642100 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:49.642857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:49.643284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:49.772818 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:49.780296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20805ef6-8b84-466f-9d11-da48c405a785 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.150004 May 11 09:52:49.780959 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 88/190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:49 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:50.585841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:50.586703 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:50.593222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:50.593661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:50.594419 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:50.594847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:50.720676 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:50.728167 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c1d1bbab-0a70-421d-8a7e-bab6bec5291a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.146736 May 11 09:52:50.728725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 103/191] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:50 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:50.798138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:50.798746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:50.805064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:50.805509 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:50.806272 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:50.806700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:50.934054 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:50.941581 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c67e062c-d13a-4f2c-af37-ef0e75b6d131 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.147276 May 11 09:52:50.942313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 89/192] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:50 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:51.745104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:51.745740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:51.751515 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:51.751997 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:51.752745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:51.753174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:51.882291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:51.889988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fe16428d-8905-46b0-9255-b173d8712957 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.149235 May 11 09:52:51.890668 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 104/193] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:51 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:51.959816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:51.960427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:51.966883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:51.967331 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:51.968203 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:51.968634 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:52.095130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:52.102920 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6d63ee9e-a8ab-4522-b416-0a31922ecaaf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.147142 May 11 09:52:52.103478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 90/194] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:51 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:52.906906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:52.907518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:52.913428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:52.913879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:52.914646 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:52.915077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:53.039963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:53.047211 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-39b54e01-cc7c-4053-b7c4-75dfb4bdf737 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.144171 May 11 09:52:53.047911 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 105/195] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:52 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:53.119357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:53.119990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:53.126275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:53.126718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:53.127478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:53.127940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:53.251106 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:53.258985 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bca4233e-6e29-4ff0-875e-1939799077ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.143934 May 11 09:52:53.259535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 91/196] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:53 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:54.064224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:54.065465 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:54.071657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:54.072347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:54.073131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:54.073547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:54.204039 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:54.212141 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-247f3772-39d7-4a5f-981f-10212161d761 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.151705 May 11 09:52:54.212855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 106/197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:54 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:54.276339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:54.276967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:54.283423 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:54.283906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:54.284678 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:54.285116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:54.413044 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:54.420333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-37b0af2c-3951-46bf-93a7-1251bc018fa9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.148567 May 11 09:52:54.420895 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 92/198] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:54 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:52:55.228538 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:55.229146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:55.235045 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:55.235490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:55.236275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:55.236706 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:55.358089 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:55.365258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-33399b35-3aae-4038-9b61-1aeb57603b9c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.140512 May 11 09:52:55.365827 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 107/199] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:55 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:55.437075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:55.437743 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:55.443885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:55.444968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:55.445737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:55.446165 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:55.580743 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:55.588598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6531e8f5-8733-4989-bd97-db06a198241b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.155324 May 11 09:52:55.589166 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 93/200] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:55 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:56.382064 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:56.382665 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:56.388650 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:56.389087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:56.389836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:56.390262 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:56.515878 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:56.523730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e38a604e-fa51-4d7c-be77-cbcaca780846 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.145494 May 11 09:52:56.524296 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 108/201] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:56 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:56.605089 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:56.605699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:56.612098 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:56.612535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:56.613294 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:56.613727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:56.735665 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:56.742874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7ed01765-46cf-46f5-b017-0463fe16a617 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.141571 May 11 09:52:56.743438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 94/202] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:56 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:57.540413 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:57.541031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:57.546826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:57.547520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:57.548301 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:57.548727 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:57.693544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:57.701639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fa44e3f8-6ac5-4e88-9378-501dfbcffeb8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.165534 May 11 09:52:57.703682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-4c4bcb74-929f-4852-b97f-7ae3e37a7c2c req-17196fd9-8458-4820-baa2-886247b9f354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e", "name": "network-vif-plugged", "status": "completed", "tag": "7dec1140-d648-4f71-a31a-fad530c962ca"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:52:57.711327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 109/203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:57 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:57.712610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4c4bcb74-929f-4852-b97f-7ae3e37a7c2c req-17196fd9-8458-4820-baa2-886247b9f354 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:57.713052 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4c4bcb74-929f-4852-b97f-7ae3e37a7c2c req-17196fd9-8458-4820-baa2-886247b9f354 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:57.724019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-4c4bcb74-929f-4852-b97f-7ae3e37a7c2c req-17196fd9-8458-4820-baa2-886247b9f354 service nova] Creating event network-vif-plugged:7dec1140-d648-4f71-a31a-fad530c962ca for instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e on hv-cinder-83699 May 11 09:52:57.729449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-4c4bcb74-929f-4852-b97f-7ae3e37a7c2c req-17196fd9-8458-4820-baa2-886247b9f354 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029849 May 11 09:52:57.730033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 95/204] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:52:57.759414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:57.760056 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:57.765957 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:57.766336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:57.767212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:57.767938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:58.101349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:58.108932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-62a682a9-8dbc-4eb1-a135-6202efb8041b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.353512 May 11 09:52:58.109495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 110/205] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:57 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:58.718993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:58.719846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:58.726874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:58.727302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:58.728078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:58.728477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:58.862271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:58.870312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5272f3d1-d038-4787-9a80-1124a8c5aec2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.155480 May 11 09:52:58.870892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 96/206] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:58 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:59.126139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:59.126662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:59.132594 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:59.133053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:59.133817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:59.134253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:59.257854 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:52:59.267478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-31542ee5-ccd4-49d9-afc9-1cb1f7899706 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.144816 May 11 09:52:59.268092 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 111/207] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:59 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:52:59.887345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:52:59.887979 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:52:59.894306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:59.894754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:52:59.895517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:52:59.895974 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:00.021662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:00.029146 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0c8ca67a-1b23-4a74-9b59-48e4ae3b0940 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.145578 May 11 09:53:00.029700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 97/208] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:52:59 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:00.285336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:00.285968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:00.295941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:00.296635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:00.301012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:00.301012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:00.428404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:00.436536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-de4545af-c14d-46ba-9a15-7b35819f36ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.155070 May 11 09:53:00.437095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 112/209] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:00 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:01.045638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:01.046513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:01.052531 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:01.052989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:01.053778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:01.054216 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:01.180957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:01.188333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99e900ce-f465-49cf-ac4f-ec743db22d34 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1314 microversion: 2.1 time: 0.146682 May 11 09:53:01.188903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 98/210] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:01 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:01.453738 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:01.454362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:01.460365 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:01.461100 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:01.462000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:01.462333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:01.590672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:01.597839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b00fcb5f-f147-4182-a33c-c18364b5b32e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.147912 May 11 09:53:01.598400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 113/211] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:01 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:02.206103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:02.207657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:02.215844 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:02.216703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:02.217847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:02.218219 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:02.349797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:02.357099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e344a2e-7cca-4ded-a246-744063869b79 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1499 microversion: 2.1 time: 0.155019 May 11 09:53:02.357677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 99/212] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:02 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:02.615364 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:02.617043 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:02.628503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:02.629135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:02.630111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:02.630547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:02.867586 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:02.876642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-82752e28-8205-4bda-afa1-b2ce932b9636 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.265965 May 11 09:53:02.877122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 114/213] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:02 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:03.057130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:03.057631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:03.064821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.065364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:03.066752 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.067197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:03.099142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:53:03.211038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cd58cbf7-a954-4b80-ac55-5ff96c67f100 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 204 len: 0 microversion: 2.1 time: 0.157549 May 11 09:53:03.212649 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 100/214] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:53:03 2022] DELETE /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:53:03.227766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:03.228381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:03.242787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.243231 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:03.249617 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.251172 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:03.461777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:03.474408 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b015a6f0-0a68-4cd4-b845-e42576a5fb8f tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1505 microversion: 2.1 time: 0.255082 May 11 09:53:03.475246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 115/215] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:03 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1505 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:03.895210 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:03.896095 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:03.902371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.902855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:03.903660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:03.904185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:04.046839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:04.054749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32acc21e-afdf-41d0-8f97-b640dc2c2e6d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.164979 May 11 09:53:04.055327 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 101/216] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:03 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:04.492696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:04.493276 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:04.499685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:04.500166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:04.500959 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:04.501397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:04.638378 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:04.645694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1a3aa802-8e9e-453a-984d-069319eae5bf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1505 microversion: 2.1 time: 0.157594 May 11 09:53:04.646263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 116/217] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:04 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:05.071101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:05.071880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:05.078050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:05.078710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:05.079403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:05.079884 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:05.204724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:05.212637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0beda5e-d3bf-4049-8d0c-c10fae381cf4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.145328 May 11 09:53:05.213207 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 102/218] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:05 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:05.662939 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:05.663543 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:05.669809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:05.670247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:05.670998 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:05.671423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:05.796314 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:05.804130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ba7355f1-29e4-4368-a893-f188b1aa66cd tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1505 microversion: 2.1 time: 0.145490 May 11 09:53:05.804688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 117/219] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:05 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1505 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:06.229502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:06.230134 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:06.236456 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:06.236898 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:06.237652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:06.238073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:06.369368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:06.376613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cc04ccbe-f074-4e19-954c-8416c31d2517 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.151032 May 11 09:53:06.377179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 103/220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:06 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:06.821539 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:06.822343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:06.828509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:06.828963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:06.829741 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:06.830177 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:06.967109 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:06.975047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cec404a2-4ae2-476e-9ca3-780f2a4c8a4c tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 200 len: 1505 microversion: 2.1 time: 0.157284 May 11 09:53:06.975735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 118/221] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:06 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:07.180862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-dbc25c8c-92d8-48e8-9aeb-4fddcedc60b6 req-df54033b-5815-44b3-9a06-41ced0f5d831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e", "name": "network-vif-deleted", "tag": "7dec1140-d648-4f71-a31a-fad530c962ca"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:07.190906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-dbc25c8c-92d8-48e8-9aeb-4fddcedc60b6 req-df54033b-5815-44b3-9a06-41ced0f5d831 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:07.190906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-dbc25c8c-92d8-48e8-9aeb-4fddcedc60b6 req-df54033b-5815-44b3-9a06-41ced0f5d831 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:07.200261 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-dbc25c8c-92d8-48e8-9aeb-4fddcedc60b6 req-df54033b-5815-44b3-9a06-41ced0f5d831 service nova] Creating event network-vif-deleted:7dec1140-d648-4f71-a31a-fad530c962ca for instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e on hv-cinder-83699 May 11 09:53:07.209144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-dbc25c8c-92d8-48e8-9aeb-4fddcedc60b6 req-df54033b-5815-44b3-9a06-41ced0f5d831 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 May 11 09:53:07.209744 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 104/222] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:07.393828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:07.394437 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:07.401164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:07.401612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:07.402416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:07.402848 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:07.532978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:07.540344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-adefeef2-f72c-442f-8517-007690dfada9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.151179 May 11 09:53:07.540906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 119/223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:07 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:07.993513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:07.994198 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:08.001779 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.002219 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.002987 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.003415 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.017647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] HTTP exception thrown: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Request method failure captured: May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e HTTP/1.1 May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4dkBYhjLSXnVlnIklCfP4gr_ICEMkT6AQYBN7qkzT54nTd-crv_Z_E0HzMe6bYcb3q0f34XET9BUQbwnywrRH22rCb_jZi5U7yfOzaLsQh-L9o9MSfDhhoLHN9C50FOUFy2Tkk4lda5ZTCMiEoEdOSVyrxyzwdNbWFbwC5OZjvbFEc May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: c5a4b0af04ce4c83b4720754165c938e May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesActionsTest-315462811 May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:53:08.019328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c5a4b0af04ce4c83b4720754165c938e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesActionsTest-315462811 May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: c5a4b0af04ce4c83b4720754165c938e May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesActionsTest-315462811 May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesActionsTest-315462811-project May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 6c3bda86f10c41bba122a6ff926d44f3 May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesActionsTest-315462811-project May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. May 11 09:53:08.020778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e'} May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:53:08.021637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. May 11 09:53:08.022958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:08.024295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Returning 404 to user: Instance 1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:53:08.024295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ca08769a-ab26-4a6d-b42c-b5202d2cedea tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e" status: 404 len: 111 microversion: 2.1 time: 0.031913 May 11 09:53:08.024295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 105/224] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:07 2022] GET /compute/v2.1/servers/1e4d18b8-4dbd-485e-99ac-aa7a3e675c5e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:53:08.120403 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1079095538", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "networks": [{"uuid": "9f228208-8bca-4646-b7d5-db2ea2cdbac4"}]}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:08.169349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] validate_networks() for [('9f228208-8bca-4646-b7d5-db2ea2cdbac4', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:53:08.501233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:53:08.501671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:53:08.502135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:53:08.502532 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:53:08.502937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:53:08.512258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.512699 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.513491 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.513917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.529759 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Getting quotas for project c5a4b0af04ce4c83b4720754165c938e. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:53:08.533530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Getting quotas for user 6c3bda86f10c41bba122a6ff926d44f3 and project c5a4b0af04ce4c83b4720754165c938e. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:53:08.544821 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:53:08.547012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:53:08.557742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:08.558379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:08.564712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.565161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.565933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:08.566366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:08.592390 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b817a921-d5f8-4e96-9452-79cb1664400b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475746 May 11 09:53:08.593342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 120/225] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:53:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:53:08.604171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4f34c5e-81e9-42ee-a4eb-0db103ae2c06 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:08.605138 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c4f34c5e-81e9-42ee-a4eb-0db103ae2c06 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:08.670692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c4f34c5e-81e9-42ee-a4eb-0db103ae2c06 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:08.678429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c4f34c5e-81e9-42ee-a4eb-0db103ae2c06 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1214 microversion: 2.1 time: 0.078676 May 11 09:53:08.679913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 121/226] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:08 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:53:08.720431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:08.729613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a61720ef-2b65-4bd4-a132-2876fab83279 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.175531 May 11 09:53:08.730282 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 106/227] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:08 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:53:09.696334 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:09.697017 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:09.703619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:09.704079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:09.704835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:09.706225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:09.746849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:09.747770 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:09.754756 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:09.755290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:09.756196 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:09.756625 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:09.764511 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:09.772547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1b364458-8934-4dce-ac5c-e689ed8afcb5 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1266 microversion: 2.1 time: 0.080075 May 11 09:53:09.773609 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 122/228] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:09 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:09.911834 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:09.919347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3d379a99-e2d6-43fc-960b-b9884b52b070 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.176477 May 11 09:53:09.919940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 107/229] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:09 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:10.789312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:10.789880 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:10.796515 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:10.797006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:10.797873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:10.798516 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:10.864296 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:10.871668 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c5825dfc-b852-4839-9190-b825df84b956 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1266 microversion: 2.1 time: 0.086240 May 11 09:53:10.872450 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 123/230] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:10 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:10.936885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:10.937660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:10.947849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:10.948293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:10.949244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:10.949823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:11.090758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:11.098882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b1cc750d-fed1-4acc-a715-a0e10ac732f0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.165919 May 11 09:53:11.099575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 108/231] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:10 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:11.888356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:11.888965 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:11.894967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:11.895420 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:11.896209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:11.896642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:11.957077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:11.964613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e2b6f4f7-0d66-4ce9-9125-d84553f7f499 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1266 microversion: 2.1 time: 0.080020 May 11 09:53:11.965180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 124/232] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:11 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:12.116856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:12.118435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:12.128339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:12.130306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:12.131462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:12.132637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:12.358490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:12.367984 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9c6e0911-a03e-4b16-9842-095838b472fc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.255569 May 11 09:53:12.372153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 109/233] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:12 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:12.981702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:12.983014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:12.993857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:12.994313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:12.995107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:13.000146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:13.171271 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:13.184160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e80c1a4-4968-4d05-85b7-ffe1849f8195 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.206271 May 11 09:53:13.184745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 125/234] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:12 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:13.390390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:13.391666 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:13.399679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:13.400418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:13.401558 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:13.402156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:13.640156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:13.649101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-266eb03b-87f1-4ee9-9888-edf9854a6058 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.262449 May 11 09:53:13.650381 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 110/235] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:13 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:13.790187 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-1f1862e6-9744-4b0c-8f99-53aa9dcba381 req-dbbd2033-bd82-48ac-b30a-78412e419206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aced0b5-6f45-4fd7-8706-cb3a7424234d", "tag": "757af738-03b7-4f9c-b20b-613d5225ffab"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:13.800034 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-1f1862e6-9744-4b0c-8f99-53aa9dcba381 req-dbbd2033-bd82-48ac-b30a-78412e419206 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:13.800530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-1f1862e6-9744-4b0c-8f99-53aa9dcba381 req-dbbd2033-bd82-48ac-b30a-78412e419206 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:13.811535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-1f1862e6-9744-4b0c-8f99-53aa9dcba381 req-dbbd2033-bd82-48ac-b30a-78412e419206 service nova] Creating event network-changed:757af738-03b7-4f9c-b20b-613d5225ffab for instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d on hv-cinder-83699 May 11 09:53:13.817541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-1f1862e6-9744-4b0c-8f99-53aa9dcba381 req-dbbd2033-bd82-48ac-b30a-78412e419206 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031456 May 11 09:53:13.818225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 126/236] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:14.201554 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:14.202152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:14.208545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:14.209002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:14.209760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:14.210187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:14.339544 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:14.347818 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f405e144-6065-4e51-a931-256dade4ecf7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.149996 May 11 09:53:14.348389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 111/237] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:14 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:14.666699 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:14.667817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:14.674115 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:14.674564 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:14.675327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:14.675783 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:14.809647 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:14.817827 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-66b82cc2-08d0-4d7b-9d1b-f90979a954cd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.155321 May 11 09:53:14.818587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 127/238] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:14 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:15.364244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:15.364866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:15.371349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:15.371833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:15.372642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:15.373083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:15.506168 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:15.513549 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90867cde-4a2f-4889-a774-126307aca4f8 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.153686 May 11 09:53:15.514128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 112/239] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:15 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:15.834654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:15.835299 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:15.841212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:15.841660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:15.842429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:15.842866 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:15.973948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:15.981308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c219af8e-289b-4035-94ed-5d77871f73fe tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.150485 May 11 09:53:15.982247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 128/240] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:15 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:16.530104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:16.530815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:16.537574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:16.538209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:16.539179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:16.539760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:16.785641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:16.793248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e571b9e1-b382-4e75-99fc-09cd810e60ac tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.266954 May 11 09:53:16.793850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 113/241] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:16 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:16.998586 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:16.999212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:17.005253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:17.005700 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:17.006470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:17.006909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:17.151508 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:17.159739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d2880599-80b3-45e7-8457-9fc03226f4f4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.164964 May 11 09:53:17.160568 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 129/242] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:16 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:17.810088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:17.810698 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:17.817574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:17.817998 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:17.818765 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:17.819248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:17.950822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:17.958457 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8395dad1-2eb4-4f9f-8468-043761f1254e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.152095 May 11 09:53:17.959035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 114/243] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:17 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:18.177294 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:18.177844 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:18.184414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:18.184950 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:18.185715 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:18.186144 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:18.321771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:18.331222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e2cf4f6-fcf2-4fb0-8d57-47bbd424378e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.157703 May 11 09:53:18.331820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 130/244] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:18 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:18.975680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:18.976478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:18.983271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:18.983725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:18.984567 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:18.985008 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:19.126846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:19.134416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27efef4f-600c-4057-9905-1f977da6a6ca tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.162601 May 11 09:53:19.134978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 115/245] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:18 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:19.350003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:19.350521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:19.356486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:19.356933 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:19.357692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:19.358124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:19.496694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:19.506239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d4bd8a8b-a6a2-4968-8160-2dd81111c2ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.160216 May 11 09:53:19.506810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 131/246] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:19 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:20.151755 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:20.152358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:20.159263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.159739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.160508 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.160947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.298789 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:20.307096 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b386ab98-21b8-4b0f-8db7-7d33318d04c0 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.159171 May 11 09:53:20.307787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 116/247] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:20 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:20.522525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:20.523891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:20.530692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.531050 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.531940 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.532407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.684855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:20.692988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1a79c1c2-2d75-4a1e-8d02-a7e711429f27 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.174538 May 11 09:53:20.693719 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 132/248] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:20 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:20.725938 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:20.726427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:20.732587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.733247 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.734059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:20.734495 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:20.761511 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7d9ffad3-899c-46d5-abd5-b2228134e522 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/ips" status: 200 len: 151 microversion: 2.20 time: 0.039553 May 11 09:53:20.762577 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 117/249] 10.222.0.44 () {60 vars in 1288 bytes} [Wed May 11 09:53:20 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:53:21.324428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:21.325069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:21.331362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.331847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.332616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.333150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.462002 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:21.469769 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fb57260f-9c8e-429a-8e45-614bae71688d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.149142 May 11 09:53:21.470329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 133/250] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:21 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:21.709084 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:21.709699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:21.715874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.716329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.717095 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.717530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.850657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:21.858025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b19f17cf-5168-4d71-ae6d-c3dd36f7e94a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1501 microversion: 2.1 time: 0.152694 May 11 09:53:21.858632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 118/251] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:21 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:21.874470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a66d4c0-9e33-433b-969c-cfb2ec69bd8d"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:21.875639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:21.881652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.882216 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.883060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.883589 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.909982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] HTTP exception thrown: Cannot 'attach_volume' instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e while it is in vm_state rescued May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Request method failure captured: May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/os-volume_attachments HTTP/1.1 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 74 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpVnFwjHwqwuobvyTiROm4k6LTpNK2ruFLnzVXHbHlU_TJpO7NlHLdT8nAoMQY5ZkcOZ0cUkBFL6H4NwAwWsvYcP3Q49AsXYZfuEPR4F3wuO9kvaqdZYL3daukv5VXh9diTFKRse-nuMXcJld28WgwhoRDPkZjXj17xm-CNUyjUYE May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:53:21.911726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8ac5dee78b854e3cbe6a7d8dbba88554", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 332b151b87ec412195fab910140cd163 May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {"volumeAttachment": {"volumeId": "6a66d4c0-9e33-433b-969c-cfb2ec69bd8d"}} May 11 09:53:21.912979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Cannot 'attach_volume' instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e while it is in vm_state rescued May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'server_id': '1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e', 'body': {'volumeAttachment': {'volumeId': '6a66d4c0-9e33-433b-969c-cfb2ec69bd8d'}}} May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e in vm_state rescued. Cannot attach_volume while the instance is in this state. May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:53:21.913653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e while it is in vm_state rescued May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:21.914696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e while it is in vm_state rescued May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Returning 409 to user: Cannot 'attach_volume' instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e while it is in vm_state rescued {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3e1ddb44-d669-4999-a5a1-40f349de32bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043011 May 11 09:53:21.916025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 134/252] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:53:21 2022] POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 09:53:21.922824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:21.923646 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:21.929918 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.930673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:21.931619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:21.932242 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.009479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-98f6afe6-dd70-408a-848a-6f1dbb0ddcd1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/action" status: 202 len: 0 microversion: 2.1 time: 0.090622 May 11 09:53:22.010452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 119/253] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:53:21 2022] POST /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:53:22.025946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:22.026906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:22.034898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:22.035598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.036901 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:22.037740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.233239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:22.240976 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b262226a-f6be-4499-bf4d-d95a1dc88beb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.226460 May 11 09:53:22.241537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 135/254] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:22 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:22.487713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:22.488530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:22.498538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:22.499956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.500993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:22.501488 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.560747 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-807d875e-cb3e-44da-8f9a-f6e39a6c14ff req-69cd4312-367a-4d3a-b757-105ec4a4cb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aced0b5-6f45-4fd7-8706-cb3a7424234d", "name": "network-vif-plugged", "status": "completed", "tag": "757af738-03b7-4f9c-b20b-613d5225ffab"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:22.570486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-807d875e-cb3e-44da-8f9a-f6e39a6c14ff req-69cd4312-367a-4d3a-b757-105ec4a4cb1a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:22.571215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-807d875e-cb3e-44da-8f9a-f6e39a6c14ff req-69cd4312-367a-4d3a-b757-105ec4a4cb1a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:22.583456 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-807d875e-cb3e-44da-8f9a-f6e39a6c14ff req-69cd4312-367a-4d3a-b757-105ec4a4cb1a service nova] Creating event network-vif-plugged:757af738-03b7-4f9c-b20b-613d5225ffab for instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d on hv-cinder-83699 May 11 09:53:22.589333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-807d875e-cb3e-44da-8f9a-f6e39a6c14ff req-69cd4312-367a-4d3a-b757-105ec4a4cb1a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 May 11 09:53:22.590168 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 136/255] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:22.716524 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:22.726808 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43d3bc68-ebd8-476e-91a1-bcd69f575f5e tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.243841 May 11 09:53:22.727785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 120/256] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:22 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:23.002697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:23.003541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:23.009599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.010048 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.010821 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.011256 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.048570 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lazy-loading 'flavor' on Instance uuid 171adcea-6dc1-4564-90ca-371a791011fa {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:53:23.258226 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:23.259562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:23.269852 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.270523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.276962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.277663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.390533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5791b5b6-a24c-49e4-a383-8eadcbf255be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/action" status: 202 len: 0 microversion: 2.20 time: 0.390955 May 11 09:53:23.391980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 137/257] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 09:53:22 2022] POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:53:23.400196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:23.401018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:23.408211 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.408737 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.409600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.410098 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.468460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:23.483324 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b09fb769-13c2-4220-9fde-6b93edd929a9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.227556 May 11 09:53:23.488002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 121/258] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:23 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:53:23.575806 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:23.584051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:23.585432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:23.586575 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6e814bb6-a2ab-40cf-990c-c38ac52fa85d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.190681 May 11 09:53:23.587368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 138/259] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:23 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:23.744155 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:23.744759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:23.751623 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.752239 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.754346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:23.754346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:23.885126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:23.892897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac5ec923-f5c4-4c84-838f-74afc258b404 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.152481 May 11 09:53:23.893550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 122/260] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:23 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:24.500974 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:24.501560 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:24.507449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.507928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:24.508697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.510960 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:24.604566 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:24.605265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:24.611724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.612315 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:24.613083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.613516 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:24.639980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:24.648336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-707ea593-4427-4eca-a1b7-a177d0164689 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.151291 May 11 09:53:24.648910 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 139/261] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:24 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:24.741341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:24.749547 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:24.751101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:24.752253 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8571d7bd-2880-4944-9f63-4190352268a6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.151555 May 11 09:53:24.752812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 123/262] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:24 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:24.910780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:24.911381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:24.917528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.917967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:24.918718 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:24.919139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:25.047096 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:25.054442 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2c2e42aa-e6e0-406a-8f8f-c3563a72c10d tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.147479 May 11 09:53:25.055004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 140/263] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:24 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:25.669055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:25.669668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:25.676414 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:25.676860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:25.677620 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:25.678047 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:25.770308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:25.771051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:25.777004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:25.777520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:25.778343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:25.778835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:25.803088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:25.810306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2e678adf-52ea-49c7-b565-989831ffb2d9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.145281 May 11 09:53:25.810874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 124/264] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:25 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:25.901405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:25.909503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:25.910988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:25.912156 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3fea194f-de35-4a56-a38b-580365d374c2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.145795 May 11 09:53:25.912715 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 141/265] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:25 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:26.071823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:26.072359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:26.078339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.078789 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.079545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.080009 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.204308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:26.211717 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-123d7da4-fa64-4f4c-9635-d9d9066afdaf tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.143763 May 11 09:53:26.212314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 125/266] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:26 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:26.827063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:26.827571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:26.833589 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.834037 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.834795 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.835228 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.930525 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:26.931930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:26.938930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.939376 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.940192 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:26.940630 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:26.963419 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:26.970875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fb7037fc-69ef-4762-9950-9b8baa672ed2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.148366 May 11 09:53:26.971437 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 142/267] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:26 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:27.076872 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:27.084650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:27.086094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:27.087237 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32359ee9-485e-4348-acc6-54e06dbd04d8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.160748 May 11 09:53:27.087816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 126/268] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:26 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:27.229760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:27.230550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:27.237554 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:27.238000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:27.238773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:27.239202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:27.378323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:27.385566 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f8c4898a-3142-42c5-a8c9-279e7258aa13 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.160177 May 11 09:53:27.386131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 143/269] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:27 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:53:27.987724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:27.988326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:27.994655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:27.995103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:27.995909 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:27.996377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:28.107549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:28.108188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:28.116225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:28.117210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:28.118956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:28.119502 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:28.132207 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:28.144597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-160c5d4a-18d7-4eb9-bbfa-439b6a9657f5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.160419 May 11 09:53:28.145484 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 127/270] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:27 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:28.248975 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:28.257406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:28.258896 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:28.260234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c979b08f-e6ed-4c06-ac0d-77e02ea50c04 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.156709 May 11 09:53:28.260787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 144/271] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:28 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:28.401984 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:28.402585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:28.408515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:28.408954 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:28.409713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:28.410149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:28.543228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:28.550766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6d4a5f4f-a1a8-4ebd-a5f6-3134521a5627 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.152502 May 11 09:53:28.551349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 128/272] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:28 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:29.166600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:29.167317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:29.174785 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.175230 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.176215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.176649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.278351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:29.278972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:29.285641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.286196 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.287654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.288115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.304872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:29.312723 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-465dbd77-dbac-49ad-b106-dbbbe4bac72d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.150273 May 11 09:53:29.313287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 145/273] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:29 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:29.386255 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:29.386737 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:29.392541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.392985 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.393742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.394170 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.418882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:29.424533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5f0f1efb-4d80-4af4-87dc-1cbfd463a381 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/ips" status: 200 len: 145 microversion: 2.1 time: 0.042050 May 11 09:53:29.429742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 146/274] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:53:29 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:53:29.429891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:29.429891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:29.430271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a2e8e7f8-0beb-4f29-a2d0-864ec38dddf2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.155759 May 11 09:53:29.430826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 129/275] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:29 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:29.566635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:29.567344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:29.573401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.573843 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.574592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:29.575044 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:29.698715 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:29.705967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c65bb164-8c9b-40e0-9c83-31a5d86708bc tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.143138 May 11 09:53:29.706522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 147/276] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:29 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:30.333141 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:30.333996 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:30.340788 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.341246 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.342041 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.342478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.449157 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:30.449762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:30.456196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.456640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.457407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.457839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.475209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:30.482416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a183a67-11f9-48de-b0e6-46cd6cb5667f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.153264 May 11 09:53:30.482995 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 130/277] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:30 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:30.586982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:30.594932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:30.596561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:30.597808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dacf8084-0b20-4a1b-b885-0fc20c8da37d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.152460 May 11 09:53:30.598399 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 148/278] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:30 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:30.721810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:30.722413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:30.728472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.728857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.729613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:30.730042 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:30.863573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:30.872495 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fa3d6b97-6111-4d3b-ad41-af0d40ecae4b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.154511 May 11 09:53:30.873914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 131/279] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:30 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:31.498415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:31.499024 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:31.504970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.505418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:31.506184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.506612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:31.616606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:31.617218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:31.623371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.623865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:31.624633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.625069 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:31.640589 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:31.647931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1db50942-a4a1-49a4-97ac-fa9b60ba3f09 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.153393 May 11 09:53:31.648508 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 149/280] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:31 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:31.749172 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:31.756961 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:31.758471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:31.759624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0363da72-0cec-48dc-a75f-3ff722702f1d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.147052 May 11 09:53:31.760222 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 132/281] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:31 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:31.890133 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:31.890772 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:31.896554 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.897003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:31.897771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:31.898209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:32.026527 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:32.034250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dc226329-87b4-4c4d-b344-025fbd983fef tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.148510 May 11 09:53:32.034811 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 150/282] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:31 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:32.664767 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:32.665481 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:32.672854 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:32.673427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:32.674476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:32.674933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:32.778260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:32.778976 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:32.785488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:32.786151 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:32.786943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:32.787369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:32.805518 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:32.813005 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f10f473-942c-49a5-892d-f1137346d623 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.152271 May 11 09:53:32.813583 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 133/283] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:32 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:32.912537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:32.920322 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:32.921802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:32.922944 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e0f44643-1d94-42f8-bf72-b343ad565504 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.148626 May 11 09:53:32.923527 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 151/284] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:32 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:33.050141 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:33.050741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:33.056622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.057062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.057847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.058273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.182499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:33.190333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-405100a4-1aab-4617-b875-5478a07c1bb7 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.143988 May 11 09:53:33.190901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 134/285] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:33 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:33.829912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:33.830515 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:33.836453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.836904 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.837661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.838097 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.941760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:33.942590 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:33.949090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.949543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.950315 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:33.950744 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:33.972445 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:33.982213 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6772af41-b28b-4f55-8469-c47ec2347f94 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1509 microversion: 2.1 time: 0.156133 May 11 09:53:33.983592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 152/286] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:33 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:34.105036 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:34.113366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:34.114860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:34.116031 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d0f07c6e-4634-4c3e-9c89-ba449beed4eb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.178301 May 11 09:53:34.116588 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 135/287] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:33 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:34.206331 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:34.206847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:34.212856 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:34.213297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:34.214099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:34.214528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:34.346764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:34.354695 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0c57c840-0cad-4663-bc11-2a98aee4196b tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.152280 May 11 09:53:34.355254 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 153/288] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:34 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:35.000496 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:35.001099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:35.007408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.007892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.008654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.009081 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.137241 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:35.138040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:35.151888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.152687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.153598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.154306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.170804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:35.180507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71f3746a-2c91-4ecd-8916-437cf8f56091 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1515 microversion: 2.1 time: 0.184259 May 11 09:53:35.181591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 136/289] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:34 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:35.296725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:35.304503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:35.305992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:35.307127 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c7ae43f4-50ee-4b52-ab45-ae54aa0ebdee tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.174779 May 11 09:53:35.307675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 154/290] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:35 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:35.377098 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:35.377741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:35.383957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.384578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.385410 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.385918 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.548750 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:35.556006 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3c774b5-b968-4fac-b7a5-3b57353225fa tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1314 microversion: 2.1 time: 0.183380 May 11 09:53:35.556569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 137/291] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:35 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:35.932251 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f66c90a-8ac8-463b-a759-0bc2f68b1b15"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:35.933374 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:35.939124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.939563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:35.940348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:35.940776 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:36.326584 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:36.327187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:36.333389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:36.333831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:36.334596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:36.335026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:36.472591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:36.481196 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:36.482744 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:36.483948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6e299dbe-923f-4975-bfcc-7981c68edc0f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.161763 May 11 09:53:36.484513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 138/292] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:36 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:36.573331 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:36.573944 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:36.581212 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:36.581577 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:36.582356 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:36.582808 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:36.721747 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:36.729079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9d082e6-69b6-4d7b-81b6-8a4bab1c2c3a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1498 microversion: 2.1 time: 0.160222 May 11 09:53:36.729645 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 139/293] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:36 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:37.502412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:37.503008 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:37.509271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:37.509712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:37.510464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:37.510891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:37.634792 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:37.643029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:37.644572 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:37.645728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e6e8d6e5-a682-4131-bce2-ca448f90b41e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.147273 May 11 09:53:37.646289 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 140/294] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:37 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:38.665278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:38.665904 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:38.673746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:38.674199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:38.674978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:38.675599 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:38.778071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6c8d63f8-c5d5-4fa7-8e07-059f05d308ab tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.849472 May 11 09:53:38.780041 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 155/295] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:53:35 2022] POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments => generated 194 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:38.906461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:38.914728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:38.916278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:38.917432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dbe9e621-8890-4028-8039-6cf6a457ac2e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.256732 May 11 09:53:38.918156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 141/296] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:38 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:39.370842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:39.371427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:39.378006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.378616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:39.379460 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.379993 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:39.406317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:53:39.495920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0ade0b0b-6778-4d95-a272-86fd960ef68a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 204 len: 0 microversion: 2.1 time: 0.129390 May 11 09:53:39.496640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 156/297] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:53:39 2022] DELETE /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:53:39.505467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:39.506312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:39.512392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.512895 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:39.514165 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.514593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:39.645532 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:39.653218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5999960a-8154-4447-9b4b-ac01bccebbb2 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1504 microversion: 2.1 time: 0.151918 May 11 09:53:39.654329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 142/298] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:39 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:39.689943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d483f0da-8089-441d-911d-2f088bbd3de0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: .version_select at 0x7f8bcd8808b0>, body: {"keypair": {"name": "tempest-keypair-14458741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/PRZRWtSe4VnwqTCaD1Nw7nviFUyOYuoM3BTftSjfEgMg70+aHbmKxXMQsrsCslQNV7zlv67lagwlDWQL/A4nqrO7g9MdiJseGn7Q+KpRJK1nAbQh/BtR6MPXB2KO37Q=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:39.704104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-d483f0da-8089-441d-911d-2f088bbd3de0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:53:39.708283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-d483f0da-8089-441d-911d-2f088bbd3de0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for user 332b151b87ec412195fab910140cd163 and project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:53:39.729932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d483f0da-8089-441d-911d-2f088bbd3de0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044728 May 11 09:53:39.730542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 157/299] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:53:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:39.936819 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:39.937486 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:39.944598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.945284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:39.947028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:39.958826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:40.120231 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:40.133883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:40.135401 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:40.136593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-48b05f29-d855-432b-94e2-957b176739f8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.205003 May 11 09:53:40.137151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 143/300] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:39 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:40.671218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:40.671988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:40.678279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:40.678724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:40.679483 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:40.680114 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:40.886626 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:40.894479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-991257a3-64bc-4e39-8e69-843b25560353 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1504 microversion: 2.1 time: 0.227609 May 11 09:53:40.895264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 158/301] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:40 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:41.154242 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:41.154864 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:41.155917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1106473793", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92fa9ce6-f537-4fd2-a602-65c692f775d2"}], "security_groups": [{"name": "tempest-securitygroup--1295837095"}], "key_name": "tempest-keypair-14458741", "user_data": "}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:41.161384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.161838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.162879 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.163314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.263507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] validate_networks() for [('92fa9ce6-f537-4fd2-a602-65c692f775d2', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:53:41.312306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:41.320752 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:41.322340 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:41.323508 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2ff76070-301d-4121-a1aa-db7fa2070263 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.173115 May 11 09:53:41.324300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 144/302] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:41 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:53:41.657868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:53:41.658325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:53:41.658793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:53:41.659306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:53:41.659834 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:53:41.670672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.671125 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.671965 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.672522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.690641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:53:41.694545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Getting quotas for user 332b151b87ec412195fab910140cd163 and project 8ac5dee78b854e3cbe6a7d8dbba88554. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:53:41.705366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:53:41.707640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:53:41.754400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-bde76b43-e460-4010-a4f2-1aabfc9e1fdf tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.602688 May 11 09:53:41.755221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 159/303] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:53:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:53:41.764759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dd91cdce-1f32-42fb-a834-b4606e646307 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:41.765372 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dd91cdce-1f32-42fb-a834-b4606e646307 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:41.828543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dd91cdce-1f32-42fb-a834-b4606e646307 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:41.835750 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dd91cdce-1f32-42fb-a834-b4606e646307 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1244 microversion: 2.1 time: 0.074720 May 11 09:53:41.836762 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 145/304] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:41 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:41.910635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:41.911360 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:41.919142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.919722 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.920637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.921252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.936809 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-36482f00-9173-47fd-bd24-40a12bb70247 req-56659d86-f17e-4672-bac5-155c06b9c5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aced0b5-6f45-4fd7-8706-cb3a7424234d", "name": "network-vif-deleted", "tag": "757af738-03b7-4f9c-b20b-613d5225ffab"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:41.946233 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-36482f00-9173-47fd-bd24-40a12bb70247 req-56659d86-f17e-4672-bac5-155c06b9c5c9 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:41.946973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-36482f00-9173-47fd-bd24-40a12bb70247 req-56659d86-f17e-4672-bac5-155c06b9c5c9 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:41.968242 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-36482f00-9173-47fd-bd24-40a12bb70247 req-56659d86-f17e-4672-bac5-155c06b9c5c9 service nova] Creating event network-vif-deleted:757af738-03b7-4f9c-b20b-613d5225ffab for instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d on hv-cinder-83699 May 11 09:53:41.976917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-36482f00-9173-47fd-bd24-40a12bb70247 req-56659d86-f17e-4672-bac5-155c06b9c5c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043149 May 11 09:53:41.978415 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 146/305] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:53:42.030133 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c3bda86f10c41bba122a6ff926d44f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4b0af04ce4c83b4720754165c938e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:42.040382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e8d8057e-3592-414e-a26a-4364d9bab5a3 tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 200 len: 1462 microversion: 2.1 time: 0.133606 May 11 09:53:42.043799 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 160/306] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:41 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:42.342277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:42.342958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:42.349449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:42.349994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:42.350652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:42.351079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:42.486017 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:42.495229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:42.497544 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:42.498739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20f0259c-5c11-4bf9-bf7d-78b577f5a536 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.160647 May 11 09:53:42.509820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 147/307] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:42 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:42.854608 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:42.855147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:42.862149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:42.862796 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:42.863738 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:42.864171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:42.932411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:42.941188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b49cdec2-40f0-4b0d-b602-1774e7377429 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1296 microversion: 2.1 time: 0.092174 May 11 09:53:42.948144 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 161/308] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:42 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:43.058299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:43.059001 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] [instance: 3aced0b5-6f45-4fd7-8706-cb3a7424234d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:43.065550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.066092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.066944 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.067445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.083217 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] HTTP exception thrown: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Request method failure captured: May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d HTTP/1.1 May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4dkBYhjLSXnVlnIklCfP4gr_ICEMkT6AQYBN7qkzT54nTd-crv_Z_E0HzMe6bYcb3q0f34XET9BUQbwnywrRH22rCb_jZi5U7yfOzaLsQh-L9o9MSfDhhoLHN9C50FOUFy2Tkk4lda5ZTCMiEoEdOSVyrxyzwdNbWFbwC5OZjvbFEc May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: c5a4b0af04ce4c83b4720754165c938e May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesActionsTest-315462811 May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:53:43.084915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c5a4b0af04ce4c83b4720754165c938e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c5a4b0af04ce4c83b4720754165c938e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesActionsTest-315462811 May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: c5a4b0af04ce4c83b4720754165c938e May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesActionsTest-315462811 May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesActionsTest-315462811-project May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 6c3bda86f10c41bba122a6ff926d44f3 May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesActionsTest-315462811-project May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. May 11 09:53:43.086178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '3aced0b5-6f45-4fd7-8706-cb3a7424234d'} May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:53:43.086871 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. May 11 09:53:43.088300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:53:43.090103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] Returning 404 to user: Instance 3aced0b5-6f45-4fd7-8706-cb3a7424234d could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:53:43.090103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9940493c-911a-4344-8feb-0fab8b36aa7a tempest-VolumesActionsTest-315462811 tempest-VolumesActionsTest-315462811-project] 10.222.0.44 "GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d" status: 404 len: 111 microversion: 2.1 time: 0.031837 May 11 09:53:43.090103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 148/309] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:43 2022] GET /compute/v2.1/servers/3aced0b5-6f45-4fd7-8706-cb3a7424234d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:53:43.517423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:43.518036 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:43.524505 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.525234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.526011 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.526452 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.958541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:43.959523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:43.960654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:43.969630 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.969868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:43.970483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.971425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:43.971888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:43.972390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:43.973926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-442f7222-6b9f-4583-ae64-abfea6ebdee0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.460607 May 11 09:53:43.974579 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 162/310] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:43 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:44.220874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:44.228347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9b3d19f9-98c9-4592-9f35-4bf490ae7cb8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.274111 May 11 09:53:44.228986 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 149/311] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:43 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:44.825913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-4246f0bb-b390-452c-9b90-897f4a4c0256 req-28e88db1-22f3-4ce8-b332-265740ad2d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:44.836297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4246f0bb-b390-452c-9b90-897f4a4c0256 req-28e88db1-22f3-4ce8-b332-265740ad2d92 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:44.836740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4246f0bb-b390-452c-9b90-897f4a4c0256 req-28e88db1-22f3-4ce8-b332-265740ad2d92 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:44.860283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-4246f0bb-b390-452c-9b90-897f4a4c0256 req-28e88db1-22f3-4ce8-b332-265740ad2d92 service nova] Creating event network-changed:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:53:44.865350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-4246f0bb-b390-452c-9b90-897f4a4c0256 req-28e88db1-22f3-4ce8-b332-265740ad2d92 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043635 May 11 09:53:44.865947 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 163/312] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:53:44.993389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:44.994649 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:45.001517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:45.002485 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:45.003479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:45.003994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:45.136245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:45.143991 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:45.145589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:45.146768 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e5c9399f-827a-4fcd-aca0-3f14f399b234 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.158007 May 11 09:53:45.147318 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 150/313] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:44 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:45.246619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:45.248124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:45.261790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:45.261790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:45.261790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:45.261790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:45.397185 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:45.405547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f6e0aacf-7891-4137-b105-a4c050211535 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.162930 May 11 09:53:45.406130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 164/314] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:45 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:46.165148 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:46.165746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:46.172195 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:46.172661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:46.173417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:46.173843 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:46.298400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:46.306208 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:46.307728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:46.309378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fdc9e5a5-c366-49fc-8423-55a33eeef62f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.147887 May 11 09:53:46.309932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 151/315] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:46 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:46.422863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:46.423469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:46.429728 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:46.430175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:46.430927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:46.431351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:46.554414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:46.562147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2117ec3c-8b81-4405-9c41-efd92d382895 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.143073 May 11 09:53:46.562700 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 165/316] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:46 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:47.327908 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:47.328516 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:47.334750 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:47.335202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:47.335997 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:47.336430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:47.461764 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:47.469392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:47.470926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:47.472096 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c05aa99-d0d4-4e28-9201-fc953f541a5c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.148654 May 11 09:53:47.472651 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 152/317] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:47 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:47.578776 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:47.579312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:47.585768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:47.586212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:47.586967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:47.587392 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:47.707818 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:47.714874 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-14e39de2-91d9-4351-b881-9d5bc9ddc0f7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.140539 May 11 09:53:47.715432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 166/318] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:47 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:48.489995 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:48.490602 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:48.496837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:48.497283 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:48.498043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:48.498474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:48.621717 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:48.629469 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:48.630959 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:48.632131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8cf1dc85-4100-4859-968e-edc53f69c010 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.146019 May 11 09:53:48.632693 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 153/319] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:48 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:48.731545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:48.732187 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:48.738456 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:48.738903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:48.739661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:48.740116 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:48.865471 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:48.872650 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2f1325fc-d599-4ff2-8046-3f8efa531204 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.145153 May 11 09:53:48.873237 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 167/320] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:48 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:49.652539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:49.653148 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:49.659398 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:49.659869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:49.660622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:49.661049 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:49.785663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:49.795640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:49.797260 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:49.798405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2a7b17f6-6e19-4ed1-9e1d-ee225966b715 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.151757 May 11 09:53:49.798953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 154/321] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:49 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:49.888379 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:49.888980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:49.895218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:49.895660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:49.896457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:49.896887 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:50.025892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:50.033551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f71057b5-ed94-4624-99c5-778d23248187 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.148946 May 11 09:53:50.034110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 168/322] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:49 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:50.816456 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:50.817051 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:50.823409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:50.824388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:50.825154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:50.825580 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:50.950218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:50.957883 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:50.959395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:50.960574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50be8cf8-ce06-42a7-aa32-7bd067313652 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.148002 May 11 09:53:50.961140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 155/323] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:50 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:51.050205 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:51.050815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:51.057073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:51.057550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:51.058312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:51.058746 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:51.179779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:51.187397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c4eea7ed-c182-41cd-b28c-4f197ce123c5 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.141035 May 11 09:53:51.187989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 169/324] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:51 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:51.978449 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:51.979004 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:51.985337 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:51.985779 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:51.986539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:51.986968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:52.110030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:52.117670 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:52.119158 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:52.120365 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eab52ea1-6c8e-4983-ac14-2e6549db6260 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.145948 May 11 09:53:52.121416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 156/325] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:51 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:52.204457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:52.205063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:52.211364 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:52.211837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:52.212599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:52.213024 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:52.337318 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:52.344494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ab0eaa0c-323c-44cf-9d12-3830ef879120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.143860 May 11 09:53:52.345060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 170/326] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:52 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:53.138910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:53.139553 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:53.146038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:53.146489 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:53.147263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:53.147719 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:53.281567 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:53.289480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:53.290969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:53.292137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-038d2402-6d26-4219-937b-d559dffaa293 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.157641 May 11 09:53:53.292765 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 157/327] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:53 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:53.360817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:53.361568 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:53.367846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:53.368294 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:53.369055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:53.369488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:53.493890 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:53.501071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ef253070-1803-447c-ba63-c25c2b9b1f52 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.144072 May 11 09:53:53.501635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 171/328] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:53 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:54.309780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:54.310379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:54.316711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:54.317149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:54.317898 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:54.318322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:54.441666 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:54.449592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:54.451103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:54.452287 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0fc5729b-a765-4752-9068-51395ed01cb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.146554 May 11 09:53:54.452837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 158/329] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:54 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:54.517771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:54.518373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:54.524577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:54.525018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:54.525889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:54.526321 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:54.656202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:54.665135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1e7804a8-d4df-4328-a9c0-1a1f581c7240 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.151204 May 11 09:53:54.665780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 172/330] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:54 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:55.469459 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:55.470064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:55.476406 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:55.476856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:55.477622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:55.478054 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:55.626825 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:55.636533 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:55.638349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:55.639669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e6b9a470-a385-4ea9-b152-6dcebddff4bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1744 microversion: 2.20 time: 0.174032 May 11 09:53:55.640326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 159/331] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:55 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:55.681622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:55.682328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:55.692619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:55.693375 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:55.695731 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:55.696438 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:55.870666 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:55.879567 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cbb194af-b80c-4406-aabb-1b8081f2fdea tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.201470 May 11 09:53:55.880356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 173/332] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:55 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:56.661789 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:56.663052 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:56.669507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:56.670028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:56.671039 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:56.671971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:56.900293 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:56.903078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:56.908113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:56.916526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:56.918309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:56.918936 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:56.920831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:56.922378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-db9233f1-31b3-4267-848f-5d1636156333 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1744 microversion: 2.20 time: 0.264686 May 11 09:53:56.922692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:56.923213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 160/333] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:56 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1744 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:56.925025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:56.928715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-32a4d278-06af-4285-826f-eaae75e16241 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:53:56.939605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32a4d278-06af-4285-826f-eaae75e16241 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:56.940087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-32a4d278-06af-4285-826f-eaae75e16241 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:57.014108 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-32a4d278-06af-4285-826f-eaae75e16241 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Going to try to stop instance {{(pid=123392) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 09:53:57.067064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-32a4d278-06af-4285-826f-eaae75e16241 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action" status: 202 len: 0 microversion: 2.1 time: 0.142252 May 11 09:53:57.071038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 161/334] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:53:56 2022] POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:53:57.077653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:57.078640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:57.085797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:57.086541 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:57.087374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:57.087999 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:57.156371 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:57.168356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-04dd0395-537e-4ee3-829c-4e3bb5ef1016 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.273291 May 11 09:53:57.170819 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 174/335] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:56 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:57.269395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:57.278249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a64d6838-e144-4269-894f-8d477d11005c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.205868 May 11 09:53:57.278943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 162/336] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:57 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:57.940481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:57.941762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:57.949072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:57.949771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:57.950755 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:57.951188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:58.189952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:58.191610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:58.202340 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:58.203543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:58.231554 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:58.232260 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:58.306264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:58.320206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:58.322432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:58.324279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6ecbe659-ab67-457f-a7f5-2d25d0eb0122 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1744 microversion: 2.20 time: 0.387172 May 11 09:53:58.325018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 175/337] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:57 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1744 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:58.333111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:58.333893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:58.341339 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:58.341827 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:58.342612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:58.343047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:58.460180 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:58.471782 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b472009f-f4e5-4c63-bd85-f4b74d86b9a6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.288803 May 11 09:53:58.483392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 163/338] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:58 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:58.549252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:58.564172 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e53c9e96-b148-43a9-b874-d2216f1001c1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.237705 May 11 09:53:58.565250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 176/339] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:58 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:59.344077 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:59.347127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:59.361790 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.362252 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.363052 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.363667 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.494190 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:59.495497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:59.504285 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.505033 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.506162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.506772 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.583320 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:59.591288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:59.592841 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:59.594771 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2f134545-d7aa-4837-96a5-7bac4f30d71c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.255686 May 11 09:53:59.595875 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 164/340] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:53:59 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:53:59.607550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:53:59.614514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:53:59.621736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.622438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.623404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:53:59.624229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:53:59.781245 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:59.811673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fffd2e9f-bb89-4c3d-827f-6402e67da7d3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.322545 May 11 09:53:59.813857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 177/341] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:59 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:53:59.936823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:53:59.948575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2bf0461a-6a75-4707-8f58-94fbfe1f2e0d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.350710 May 11 09:53:59.964200 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 165/342] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:53:59 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:00.617055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:00.617642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:00.646375 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:00.647336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:00.650031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:00.653206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:00.840425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:00.841297 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:00.885778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:00.892814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:00.894641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:00.895609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:01.225930 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:01.241035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:01.243037 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:01.244677 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8abe057d-2752-4585-8904-fb35c41cd2ca tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.631797 May 11 09:54:01.245898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 178/343] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:00 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:01.254112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:01.254968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:01.266443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:01.267193 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:01.268221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:01.268822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:01.394353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:01.402564 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f63624c4-b668-4f77-bfb2-74bbf540a62d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.570924 May 11 09:54:01.425403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 166/344] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:00 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:01.441681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-cbb6cae9-8b7b-4779-84b0-abfc5c717c39 req-9f2ba0a4-00d0-4972-a766-d2c041585a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "name": "network-vif-plugged", "status": "completed", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:01.458229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-cbb6cae9-8b7b-4779-84b0-abfc5c717c39 req-9f2ba0a4-00d0-4972-a766-d2c041585a52 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:01.458917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-cbb6cae9-8b7b-4779-84b0-abfc5c717c39 req-9f2ba0a4-00d0-4972-a766-d2c041585a52 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:01.502482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-cbb6cae9-8b7b-4779-84b0-abfc5c717c39 req-9f2ba0a4-00d0-4972-a766-d2c041585a52 service nova] Creating event network-vif-plugged:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:54:01.517774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-cbb6cae9-8b7b-4779-84b0-abfc5c717c39 req-9f2ba0a4-00d0-4972-a766-d2c041585a52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089793 May 11 09:54:01.523027 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 167/345] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:01.668914 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:01.681707 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5c08e48c-d817-4b2b-95f7-3785dbcc9409 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.434570 May 11 09:54:01.683325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 179/346] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:01 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:02.264005 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:02.266332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:02.282478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.283311 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.284466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.285116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.434300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:02.434928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:02.452652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.453406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.454211 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.454655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.505798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:02.516112 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:02.518418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:02.519643 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-27569390-1eef-4811-9c04-445909259440 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.261029 May 11 09:54:02.521013 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 168/347] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:02 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:02.707147 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:02.707967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:02.715857 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.719914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.730117 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:02.731300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:02.732694 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:02.740943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-da4d16c2-6127-4a79-8626-fb1ba543d120 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.309795 May 11 09:54:02.742100 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 180/348] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:02 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:02.970978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:02.982856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a948c6a0-71ca-4b42-b91a-cb72d325833f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.287728 May 11 09:54:02.988107 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 169/349] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:02 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:03.542098 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-e297d569-4730-43f9-9e7d-38447d860ac2 req-b71af6c5-6b75-4bb2-87e1-5371055355c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "name": "network-vif-plugged", "status": "completed", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:03.545970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:03.547135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:03.572140 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:03.572655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:03.574019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:03.574924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:03.578345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e297d569-4730-43f9-9e7d-38447d860ac2 req-b71af6c5-6b75-4bb2-87e1-5371055355c8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:03.580539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e297d569-4730-43f9-9e7d-38447d860ac2 req-b71af6c5-6b75-4bb2-87e1-5371055355c8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:03.617009 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-e297d569-4730-43f9-9e7d-38447d860ac2 req-b71af6c5-6b75-4bb2-87e1-5371055355c8 service nova] Creating event network-vif-plugged:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:54:03.642441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-e297d569-4730-43f9-9e7d-38447d860ac2 req-b71af6c5-6b75-4bb2-87e1-5371055355c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106161 May 11 09:54:03.646178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 170/350] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:03.759113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:03.759869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:03.774552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:03.775609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:03.778174 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:03.778882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:03.869651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:03.888447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:03.891518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:03.896720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5af99ef8-9b68-4104-aaa3-825a741a5bb5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.362282 May 11 09:54:03.897938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 181/351] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:03 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:04.001137 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:04.002009 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:04.012180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:04.015387 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:04.016468 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:04.019128 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:04.274223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:04.283510 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0d725872-3695-44e0-8d41-4b23d9581e41 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.528770 May 11 09:54:04.288834 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 171/352] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:03 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:04.340561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:04.352877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e81b6055-c91e-4e3e-9496-765ad926b349 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.355992 May 11 09:54:04.353459 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 182/353] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:03 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:04.917441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:04.918780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:04.936031 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:04.936825 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:04.937815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:04.938459 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:05.311626 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:05.312984 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:05.336579 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:05.337481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:05.338694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:05.339387 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:05.353992 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:05.393888 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:05.409345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:05.411860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5edb5b30-e04f-4632-8a6b-6cb84efcbee8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.498149 May 11 09:54:05.414786 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 172/354] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:04 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:05.428169 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:05.429208 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:05.448691 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:05.452659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:05.459562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:05.460882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:05.605280 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:05.624657 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-750097a5-0c4e-47d5-8e06-a940eb9ab1e2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1370 microversion: 2.1 time: 0.316784 May 11 09:54:05.626019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 183/355] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:05 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1370 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:05.786125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:05.797530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5eb0e72b-b371-4a01-b325-46499b50da24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.381230 May 11 09:54:05.808990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 173/356] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:05 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:05.913214 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-773955174", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:06.439652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:06.441087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:06.461887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:06.462828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:06.464831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:06.465595 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:06.780174 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:06.787090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:06.792696 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:06.794295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-913f3acb-9ce1-4e6d-814a-c83d0d46e85b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.362839 May 11 09:54:06.805826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 174/357] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:06 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:06.816466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:06.817452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:06.829407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:06.829407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:06.840011 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:06.840011 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:06.980715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:06.988584 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a6cc7621-5dbb-4ef9-9f2b-a33d963991b9 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1564 microversion: 2.1 time: 0.181367 May 11 09:54:06.989804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 175/358] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:06 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:06.996156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:06.996156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:07.003127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.003380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:07.004347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.005179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:07.192712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:07.203418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6c98e60d-c048-4cef-b557-118c347ad4a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.212663 May 11 09:54:07.204718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 176/359] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:06 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:07.219951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:07.220468 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:07.227945 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.228519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:07.229479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.229993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:07.335764 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b3155f39-fc81-421a-b473-99fbbd5739bb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119807 May 11 09:54:07.336569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 177/360] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:54:07 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:07.813662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:07.814318 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:07.832873 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.833489 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:07.834308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:07.834741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:08.264475 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:08.274854 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:08.283021 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:08.284289 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-59f332f9-16e2-4c00-a11e-1deddb95dcb3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.476187 May 11 09:54:08.303481 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 178/361] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:07 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:54:08.310759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:08.310759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:08.344076 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:08.344539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:08.345342 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:08.345786 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:09.330101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:09.350432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-df6e6e1a-1ebc-44e5-a485-01485936b13f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 1.043728 May 11 09:54:09.362045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 179/362] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:08 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:09.376283 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:09.376850 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:09.383725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:09.384214 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:09.385066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:09.385563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:09.743979 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:09.752597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:09.754120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:09.755285 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-edcff189-1790-4cf3-954b-e808e645b79e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.383192 May 11 09:54:09.766696 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 180/363] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:09 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:10.066918 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-4cfb66f4-373d-4745-877b-91c9a5bffc4f req-25bb5a04-57ad-43c8-bfd6-d478bb0e87cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:10.081560 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4cfb66f4-373d-4745-877b-91c9a5bffc4f req-25bb5a04-57ad-43c8-bfd6-d478bb0e87cf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:10.082012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-4cfb66f4-373d-4745-877b-91c9a5bffc4f req-25bb5a04-57ad-43c8-bfd6-d478bb0e87cf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:10.104071 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-4cfb66f4-373d-4745-877b-91c9a5bffc4f req-25bb5a04-57ad-43c8-bfd6-d478bb0e87cf service nova] Creating event network-changed:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:54:10.109324 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-4cfb66f4-373d-4745-877b-91c9a5bffc4f req-25bb5a04-57ad-43c8-bfd6-d478bb0e87cf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048587 May 11 09:54:10.113030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 181/364] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:54:10.402137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:10.403123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:10.415680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:10.416703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:10.417492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:10.417919 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:10.797284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:10.811166 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-446b1137-f298-48c1-9562-6ed755635408 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.430516 May 11 09:54:10.821431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 182/365] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:10 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:10.831417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:10.832099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:10.843229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:10.843684 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:10.844631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:10.845077 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:11.144356 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:11.167993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:11.170109 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:11.171810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2015c08b-51e1-4d60-9c6c-4c47c199a185 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1739 microversion: 2.20 time: 0.349292 May 11 09:54:11.172611 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 183/366] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:10 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:11.758581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] validate_networks() for None {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:54:11.828874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:11.829803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:11.839376 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:11.839972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:11.840838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:11.845129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:12.018136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:12.028402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4d30f81f-3bae-4e8f-ad88-8c061f75e8e8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.203308 May 11 09:54:12.040911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 184/367] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:11 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:12.138991 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:54:12.139497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:54:12.140078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:54:12.140683 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:54:12.141135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:54:12.151104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:12.151903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:12.152922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:12.153572 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:12.175235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Getting quotas for project 47b12a79feef4dbabafc3f6993b45c7d. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:54:12.180955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Getting quotas for user 60dbbb1a01454a2eb76319ac170699f2 and project 47b12a79feef4dbabafc3f6993b45c7d. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:54:12.190258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:12.191099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:12.194444 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:54:12.198955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:54:12.199645 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:12.200296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:12.201262 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:12.202397 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:12.257189 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e1c944fc-db69-4a77-aff1-ea6e723e5398 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.349051 May 11 09:54:12.258563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 184/368] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:54:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 6351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:54:12.271496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c57bb3ed-618a-4a38-a115-e95d366fa7f1 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:12.272865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c57bb3ed-618a-4a38-a115-e95d366fa7f1 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:12.399764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c57bb3ed-618a-4a38-a115-e95d366fa7f1 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:12.410045 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c57bb3ed-618a-4a38-a115-e95d366fa7f1 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1214 microversion: 2.1 time: 0.145837 May 11 09:54:12.410890 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 185/369] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:12 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:12.453822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:12.465695 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:12.467749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:12.473631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bc8afcfd-a5be-4496-85cf-4272c7b7414c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1721 microversion: 2.20 time: 0.286940 May 11 09:54:12.473770 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 185/370] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:12 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:13.047956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:13.048590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:13.064862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.065115 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.066125 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.066796 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.217473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:13.225941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0a7021ee-cb06-4dd7-88c7-cba55ce30006 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.183981 May 11 09:54:13.235556 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 186/371] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:13 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:13.430348 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:13.431122 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:13.438197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.444360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.445188 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.445624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.499181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:13.499773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:13.507023 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.507759 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.508714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:13.509305 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:13.511083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:13.518826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ac615e5e-d804-4bf4-b0ec-0c4e86503906 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1266 microversion: 2.1 time: 0.092184 May 11 09:54:13.528271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 186/372] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:13 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:13.649983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:13.663535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:13.665830 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:13.667425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7f3ba345-c5de-4db6-b995-2eccc263d9be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1721 microversion: 2.20 time: 0.173059 May 11 09:54:13.668171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 187/373] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:13 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:14.242368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:14.242977 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:14.250265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.250952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.251962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.252402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.406267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:14.415628 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-60caddb2-bf25-4817-a2ce-9749510c3fe5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.177086 May 11 09:54:14.417380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 187/374] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:14 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:14.539164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:14.540307 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:14.548072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.548956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.549927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.551340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.629666 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:14.637726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-26cc5c85-59e5-4906-a3ed-218b08ae8bf8 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1266 microversion: 2.1 time: 0.104302 May 11 09:54:14.638660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 188/375] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:14 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:14.686583 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:14.687182 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:14.693839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.694567 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.695417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:14.695957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:14.838499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:14.848932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:14.849807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:14.851147 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-332f62d8-3e98-401a-a19b-20e5e1c90d88 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1721 microversion: 2.20 time: 0.168426 May 11 09:54:14.851820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 188/376] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:14 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:15.133347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-405caf00-dc70-4275-9556-f3e343f6f417 req-aea303be-79a4-41e2-906c-7e55df53cb3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "name": "network-vif-unplugged", "status": "completed", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:15.146634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-405caf00-dc70-4275-9556-f3e343f6f417 req-aea303be-79a4-41e2-906c-7e55df53cb3c service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.147169 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-405caf00-dc70-4275-9556-f3e343f6f417 req-aea303be-79a4-41e2-906c-7e55df53cb3c service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.160871 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-405caf00-dc70-4275-9556-f3e343f6f417 req-aea303be-79a4-41e2-906c-7e55df53cb3c service nova] Creating event network-vif-unplugged:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:54:15.167913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-405caf00-dc70-4275-9556-f3e343f6f417 req-aea303be-79a4-41e2-906c-7e55df53cb3c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038898 May 11 09:54:15.169645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 189/377] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:15.433569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:15.434177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:15.440285 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.440731 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.441495 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.441958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.645735 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:15.654529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8f2adff1-3bf2-4616-8377-f7cf0397550e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.224766 May 11 09:54:15.655338 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 189/378] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:15 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:15.655496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:15.656187 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:15.663130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.663797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.664728 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.665162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.728126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:15.735857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-18e30579-f6e4-419b-b127-039d94cb0c1a tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1272 microversion: 2.1 time: 0.085108 May 11 09:54:15.736358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 190/379] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:15 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1272 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:15.872278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:15.873017 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:15.879356 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.880035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:15.880801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:15.881420 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.091848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:16.100119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:16.102642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:16.103910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-adf7aff1-c031-4aa2-be6e-8b711a90fbe8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1664 microversion: 2.20 time: 0.235502 May 11 09:54:16.104480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 190/380] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:15 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1664 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:16.122404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4bce0a5c-ef50-4c97-8fdb-1747d605496e"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:16.123482 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:16.129416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.129872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.130646 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.131218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.536307 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9373c9e4-6577-4144-ae8b-2ff9e2d005a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.418084 May 11 09:54:16.537230 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 191/381] 10.222.0.44 () {62 vars in 1363 bytes} [Wed May 11 09:54:16 2022] POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments => generated 188 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:54:16.655103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:16.655662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:16.661709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.662155 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.662919 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.663349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.673494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:16.674279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:16.682636 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.683262 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.684218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.684893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.766502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1dd61c73-ad58-408a-991f-e2279fcf6a0c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/action" status: 202 len: 0 microversion: 2.20 time: 0.115145 May 11 09:54:16.767417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 191/382] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 09:54:16 2022] POST /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:54:16.773374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:16.774181 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:16.781385 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.782121 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.783061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.783672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.855825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:16.864857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6ddf8739-185f-47d2-9213-3103872a7b18 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1722 microversion: 2.1 time: 0.194151 May 11 09:54:16.865509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 192/383] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:16 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:16.870975 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:16.872076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:16.884391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.884837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:16.885637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:16.886067 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:17.044288 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:17.054062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:17.055829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:17.057352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d13d75fe-ec52-44fb-812f-11cdf67ce2b8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1750 microversion: 2.20 time: 0.190624 May 11 09:54:17.058079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 193/384] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:16 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:17.309345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:17.316937 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-557c96d1-7914-45ac-a520-f15d29b3048b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.548285 May 11 09:54:17.317970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 192/385] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:16 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:17.441201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-5f689f2a-26cf-45cc-8f06-224db6844dbf req-38c47e6a-f102-445a-be15-75af1911fd59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3d81108-2727-463c-a257-ef124d18dd71", "tag": "ae7a22d5-5b3f-4ef3-bffa-565b53d38205"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:17.461266 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5f689f2a-26cf-45cc-8f06-224db6844dbf req-38c47e6a-f102-445a-be15-75af1911fd59 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:17.461714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5f689f2a-26cf-45cc-8f06-224db6844dbf req-38c47e6a-f102-445a-be15-75af1911fd59 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:17.488199 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-5f689f2a-26cf-45cc-8f06-224db6844dbf req-38c47e6a-f102-445a-be15-75af1911fd59 service nova] Creating event network-changed:ae7a22d5-5b3f-4ef3-bffa-565b53d38205 for instance b3d81108-2727-463c-a257-ef124d18dd71 on hv-cinder-83699 May 11 09:54:17.495071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-5f689f2a-26cf-45cc-8f06-224db6844dbf req-38c47e6a-f102-445a-be15-75af1911fd59 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060361 May 11 09:54:17.496273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 194/386] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:17.885463 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:17.886558 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:17.893899 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:17.894710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:17.895751 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:17.896512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.077302 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:18.078219 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:18.085804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.086256 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.087016 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.087607 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.126539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.135571 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9e894939-d84f-4cf1-b036-180efbb3d9d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1699 microversion: 2.1 time: 0.256980 May 11 09:54:18.136575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 193/387] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:17 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1699 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:18.152770 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5fac4fa6-c482-461c-ad62-a527971c61b5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:18.159754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fac4fa6-c482-461c-ad62-a527971c61b5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.160534 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5fac4fa6-c482-461c-ad62-a527971c61b5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.185703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5fac4fa6-c482-461c-ad62-a527971c61b5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Going to try to start instance {{(pid=123392) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 09:54:18.239632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5fac4fa6-c482-461c-ad62-a527971c61b5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action" status: 202 len: 0 microversion: 2.1 time: 0.090275 May 11 09:54:18.240403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 194/388] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:54:18 2022] POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:54:18.249288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:18.250221 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:18.257014 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.257619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.258561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.259286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.290182 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.299634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.301169 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.302335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-29a80630-7e53-4d25-8033-00e612054d81 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1752 microversion: 2.20 time: 0.230493 May 11 09:54:18.302888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 195/389] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:18 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:54:18.334414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:18.335155 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:18.341708 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.342286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.343259 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:18.343865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:18.404364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.413520 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aaace677-c0fa-449e-97a7-a59799d71118 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1708 microversion: 2.1 time: 0.168287 May 11 09:54:18.414087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 195/390] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:18 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:18.474325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:18.482249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-da816c21-53d9-4426-bfce-84d3e8083fdd tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.151849 May 11 09:54:18.482822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 196/391] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:18 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:19.321191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:19.321801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:19.329377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.329826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.330604 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.331219 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.432842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:19.433516 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:19.440887 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.441329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.442094 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.442521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.610904 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:19.621462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:19.629892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:19.631403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:19.632625 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6109e7b7-7fd4-4e3b-9e9f-84770ad232b7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1752 microversion: 2.20 time: 0.315567 May 11 09:54:19.633191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 196/392] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:19 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1752 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:19.634489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0ff1bf09-5aba-4cb8-901a-01dd265f8dee tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1708 microversion: 2.1 time: 0.198244 May 11 09:54:19.635660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 197/393] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:19 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1708 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:19.648612 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:19.649258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:19.655673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.656154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.656922 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:19.657362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:19.783718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:19.791728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-167c0598-87d9-4929-b7e9-15fa327586de tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.157450 May 11 09:54:19.792508 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 197/394] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:19 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:20.650514 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:20.651305 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:20.652188 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:20.653011 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:20.657980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.658503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.659261 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.659385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.659863 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.659980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.661012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.661513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.791725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:20.804829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:20.807580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:20.808852 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cb2d37b9-4767-4bbf-9905-a59fd7a7425f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.162414 May 11 09:54:20.809574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 198/395] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:20 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:20.814847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:20.815776 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:20.823396 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.824154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.825036 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:20.825677 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:20.869820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:20.877627 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f6070ab-a283-4892-9f93-86f1023d0ef3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1708 microversion: 2.1 time: 0.229324 May 11 09:54:20.878218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 198/396] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:20 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1708 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:20.954520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:20.961775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d70a8956-2c29-418a-a813-c758e27cc851 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.151122 May 11 09:54:20.962334 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 199/397] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:20 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:21.194224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-8a49935c-f2ae-4bdc-973d-b1637a4372d4 req-9ff9d035-936d-4b85-9f4e-f8ab2c7a8e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d81108-2727-463c-a257-ef124d18dd71", "name": "network-vif-plugged", "status": "completed", "tag": "ae7a22d5-5b3f-4ef3-bffa-565b53d38205"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:21.203476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-8a49935c-f2ae-4bdc-973d-b1637a4372d4 req-9ff9d035-936d-4b85-9f4e-f8ab2c7a8e51 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:21.203961 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-8a49935c-f2ae-4bdc-973d-b1637a4372d4 req-9ff9d035-936d-4b85-9f4e-f8ab2c7a8e51 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:21.216862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-8a49935c-f2ae-4bdc-973d-b1637a4372d4 req-9ff9d035-936d-4b85-9f4e-f8ab2c7a8e51 service nova] Creating event network-vif-plugged:ae7a22d5-5b3f-4ef3-bffa-565b53d38205 for instance b3d81108-2727-463c-a257-ef124d18dd71 on hv-cinder-83699 May 11 09:54:21.221686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-8a49935c-f2ae-4bdc-973d-b1637a4372d4 req-9ff9d035-936d-4b85-9f4e-f8ab2c7a8e51 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 May 11 09:54:21.222284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 199/398] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:54:21.829815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:21.831924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:21.840446 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:21.844766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:21.846541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:21.847262 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:21.895150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:21.896443 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:21.906519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:21.906964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:21.907758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:21.908190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:22.037678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:22.052279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:22.054051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:22.055573 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-55e6b051-f71d-4014-a1c0-d1a4b9a49c33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.231221 May 11 09:54:22.056350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 200/399] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:21 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:22.068517 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:22.069147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:22.075223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:22.075919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:22.077408 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:22.077926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:22.090014 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:22.099774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1df59c15-57e7-4445-93d7-5f485f1f57d2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1712 microversion: 2.1 time: 0.208923 May 11 09:54:22.100664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 200/400] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:21 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1712 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:22.233282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:22.240744 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-660cc31c-0433-41d7-b024-9c3a767ce583 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.182244 May 11 09:54:22.241317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 201/401] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:22 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:23.074952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:23.075622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:23.082336 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:23.082795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:23.083574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:23.084045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:23.224116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:23.234273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:23.236616 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:23.237315 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-face0424-c25a-431a-8984-743e16c2955d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.167150 May 11 09:54:23.246116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 201/402] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:23 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:23.257031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:23.257701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:23.264361 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:23.264816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:23.265603 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:23.266037 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:23.402049 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:23.409681 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-84ad23ea-52c4-480b-a96f-1c7092cbc536 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.156692 May 11 09:54:23.410542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 202/403] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:23 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:24.256199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:24.256879 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:24.263938 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:24.264498 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:24.265296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:24.265738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:24.409133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:24.418241 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:24.422188 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:24.423210 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-091d6616-42e2-468a-8c87-aa81822a8c4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.170976 May 11 09:54:24.429370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:24.430499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:24.432374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 202/404] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:24 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:24.438252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:24.438793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:24.439714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:24.440417 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:24.591955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:24.600450 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a89469cb-ae9d-4dd1-95cd-6864b5881c3b tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.176071 May 11 09:54:24.609978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 203/405] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:24 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:25.444615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:25.445246 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:25.452513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:25.452963 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:25.453946 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:25.454657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:25.591802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:25.601205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:25.602715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:25.603983 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4e46d5a7-4d30-4830-ba50-fa2492ac9edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.163213 May 11 09:54:25.604547 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 203/406] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:25 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:54:25.621512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:25.622180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:25.629711 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:25.630223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:25.631079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:25.631582 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:25.766328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:25.773788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fee1ed68-ec82-48b5-81f4-b8f302a4a7b4 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.156564 May 11 09:54:25.774353 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 204/407] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:25 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:26.622505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:26.623285 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:26.630389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:26.630827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:26.631597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:26.632063 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:26.764797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:26.773503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:26.775079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:26.776792 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2e0dcd41-140e-47bd-bfe9-6313f191f7c0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.158639 May 11 09:54:26.777551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 204/408] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:26 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:26.791662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:26.792515 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:26.800038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:26.800490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:26.801273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:26.801709 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:26.934649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:26.942396 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1deafb06-40a2-414f-93ca-4efa0d374177 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.155458 May 11 09:54:26.943086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 205/409] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:26 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:27.795757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:27.796359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:27.802847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:27.803302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:27.804105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:27.804537 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:27.940278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:27.949641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:27.951225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:27.952433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f283aca7-0ac8-4570-ba93-d8525087947b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.160592 May 11 09:54:27.953203 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 205/410] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:27 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:27.959828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:27.961159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:27.967867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:27.968604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:27.969800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:27.970499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:28.148352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:28.155637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4bc1e930-5116-4d88-aa51-3d1fd6dd4696 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.200026 May 11 09:54:28.156248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 206/411] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:27 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:54:28.970541 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:28.971174 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:28.977515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:28.977961 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:28.978725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:28.979156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:29.116677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:29.126633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:29.128757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:29.130235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ef4f676-cd0e-4cae-9e7d-e05fe0626c9d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.163655 May 11 09:54:29.131163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 206/412] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:28 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:29.173179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:29.173882 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:29.180494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:29.180948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:29.182333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:29.182762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:29.325791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:29.333375 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-400d2613-d358-4492-82e5-31e5adbd22dc tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.164042 May 11 09:54:29.333947 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 207/413] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:29 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:30.149720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:30.150330 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:30.157444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:30.157891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:30.158669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:30.159103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:30.298757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:30.307082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:30.308677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:30.310882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6fcf2613-762a-4557-a248-3e38e27dbdff tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.165132 May 11 09:54:30.311439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 207/414] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:30 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:30.350243 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:30.350849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:30.357911 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:30.358350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:30.359103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:30.359533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:30.483520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:30.490675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e872adea-d363-44c0-a26d-be77f406c57f tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1314 microversion: 2.1 time: 0.144322 May 11 09:54:30.491238 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 208/415] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:30 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:31.330693 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:31.331295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:31.337335 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.337782 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.338543 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.338975 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.460923 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:31.469099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:31.470538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:31.471680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-50375e97-822d-4bf5-b162-0950178601f6 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.144935 May 11 09:54:31.472257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 208/416] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:31 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:31.506202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:31.506805 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:31.513150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.513595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.514358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.514789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.639721 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:31.646930 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2295805f-eb3c-4197-bea7-f20ca10ef111 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1464 microversion: 2.1 time: 0.144619 May 11 09:54:31.647503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 209/417] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:31 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:31.687367 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:31.688096 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:31.694385 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.695061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.696031 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.696462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.723620 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:54:31.800427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43f448ff-1ef4-4963-9c94-24aac688f127 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 204 len: 0 microversion: 2.1 time: 0.117904 May 11 09:54:31.801319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 209/418] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:54:31 2022] DELETE /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:54:31.809453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:31.810060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:31.816038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.816493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.817283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:31.817725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:31.939827 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:31.947068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9e920e1b-ae95-438d-9006-682bc78bdf66 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1470 microversion: 2.1 time: 0.141500 May 11 09:54:31.947634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 210/419] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:31 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:32.490720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:32.491321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:32.498074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:32.498519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:32.499272 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:32.499713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:32.628525 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:32.637316 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:32.638817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:32.640003 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-66aa110d-02a0-474e-90e3-718430978335 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.153601 May 11 09:54:32.640558 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 210/420] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:32 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:32.964675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:32.965306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:32.971637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:32.972112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:32.972865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:32.973291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:33.098388 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:33.105621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0176949a-7d34-4323-993d-dd6982d70d69 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1470 microversion: 2.1 time: 0.145437 May 11 09:54:33.106226 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 211/421] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:32 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:33.658482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:33.659089 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:33.665691 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:33.666138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:33.666903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:33.667386 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:33.949629 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:33.958073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:33.959585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:33.960775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9852ae48-4d29-430c-9e53-c262e364f026 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.306184 May 11 09:54:33.961335 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 211/422] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:33 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:34.123749 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:34.124415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:34.130934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:34.131386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:34.132188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:34.132630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:34.199431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:34.211121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cbb33eb2-82ef-4183-a082-7638105a6f4c tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1428 microversion: 2.1 time: 0.091777 May 11 09:54:34.211386 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-17e906d0-f0a8-4923-83db-8d2a957bc70e req-d5f0f615-8671-4abb-ba76-73cbf7333faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3d81108-2727-463c-a257-ef124d18dd71", "name": "network-vif-deleted", "tag": "ae7a22d5-5b3f-4ef3-bffa-565b53d38205"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:34.221290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-17e906d0-f0a8-4923-83db-8d2a957bc70e req-d5f0f615-8671-4abb-ba76-73cbf7333faa service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:34.221531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 212/423] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:34 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:34.222182 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-17e906d0-f0a8-4923-83db-8d2a957bc70e req-d5f0f615-8671-4abb-ba76-73cbf7333faa service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:34.233518 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-17e906d0-f0a8-4923-83db-8d2a957bc70e req-d5f0f615-8671-4abb-ba76-73cbf7333faa service nova] Creating event network-vif-deleted:ae7a22d5-5b3f-4ef3-bffa-565b53d38205 for instance b3d81108-2727-463c-a257-ef124d18dd71 on hv-cinder-83699 May 11 09:54:34.238545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-17e906d0-f0a8-4923-83db-8d2a957bc70e req-d5f0f615-8671-4abb-ba76-73cbf7333faa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 May 11 09:54:34.239162 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 212/424] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:34.978714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:34.979317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:34.985222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:34.985662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:34.986410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:34.986835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:35.109368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:35.117449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:35.118928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:35.120100 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cdf722f7-ffab-48c7-a761-3aa15338e03c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.145194 May 11 09:54:35.121252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 213/425] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:34 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:35.228688 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:35.229446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:35.236687 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:35.237140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:35.237907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:35.238347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:35.270812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:35.271266 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:35.271776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lazy-loading 'fault' on Instance uuid b3d81108-2727-463c-a257-ef124d18dd71 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:54:35.314702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbbb1a01454a2eb76319ac170699f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47b12a79feef4dbabafc3f6993b45c7d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:35.322675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8cf4a8b7-dc03-4c6c-93ed-e16f29b904d2 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 200 len: 1304 microversion: 2.1 time: 0.098202 May 11 09:54:35.327960 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 213/426] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:35 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:36.138563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:36.139092 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:36.145020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:36.145471 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:36.146236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:36.146682 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:36.272957 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:36.281675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:36.283184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:36.284372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d7cee837-6e45-4dcb-a82e-73b52d63db8b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.150442 May 11 09:54:36.284926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 214/427] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:36 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:36.346794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:36.347402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] [instance: b3d81108-2727-463c-a257-ef124d18dd71] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:36.354034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:36.354586 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:36.355860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:36.356295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:36.369234 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] HTTP exception thrown: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Request method failure captured: May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 HTTP/1.1 May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4e7yyv8BnicWOZazv8NLz-GIlpySm6Mgbfzv8blou4BoViMR0yvJIRg0RrSULwREzqKdI36bpffz35jrhqhLsNxtSPqxbmWatDjgak6qSlO5QMsES3YskSVwBheBGyi6lhhOLPxNqYo3z8PMwRY8MmXehJc4sqaq87eyBkFnLlLIcg May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 47b12a79feef4dbabafc3f6993b45c7d May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesNegativeTest-1280309246 May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:54:36.370880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47b12a79feef4dbabafc3f6993b45c7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47b12a79feef4dbabafc3f6993b45c7d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47b12a79feef4dbabafc3f6993b45c7d", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47b12a79feef4dbabafc3f6993b45c7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesNegativeTest-1280309246 May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 47b12a79feef4dbabafc3f6993b45c7d May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesNegativeTest-1280309246 May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesNegativeTest-1280309246-project May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 60dbbb1a01454a2eb76319ac170699f2 May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesNegativeTest-1280309246-project May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. May 11 09:54:36.372453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'b3d81108-2727-463c-a257-ef124d18dd71'} May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:54:36.373364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. May 11 09:54:36.374619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:54:36.375679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] Returning 404 to user: Instance b3d81108-2727-463c-a257-ef124d18dd71 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:54:36.375679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-717d1b79-fb61-4e86-9b80-56396f764d50 tempest-VolumesNegativeTest-1280309246 tempest-VolumesNegativeTest-1280309246-project] 10.222.0.44 "GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71" status: 404 len: 111 microversion: 2.1 time: 0.029343 May 11 09:54:36.375679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 214/428] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:36 2022] GET /compute/v2.1/servers/b3d81108-2727-463c-a257-ef124d18dd71 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:54:37.302649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:37.303431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:37.310315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:37.310768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:37.311545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:37.312124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:37.442797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:37.451773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:37.453283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:37.454446 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7fb11151-e64e-4eb3-b1e6-3e0e4c7d44a9 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.155651 May 11 09:54:37.455000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 215/429] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:37 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:54:38.472686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:38.473493 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:38.480589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:38.481030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:38.481788 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:38.482213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:38.617641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:38.626199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:38.627709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:38.628863 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-828d5054-7f23-415b-8f1f-ae402e1c2286 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.160263 May 11 09:54:38.629398 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 215/430] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:38 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:39.647020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:39.647623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:39.654679 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:39.655123 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:39.655916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:39.656348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:39.775875 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:39.784466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:39.786198 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:39.787334 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e0f1fdd-2e43-4e86-b5f0-07fc43b09da3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.144203 May 11 09:54:39.787928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 216/431] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:39 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:40.805447 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:40.806065 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:40.812403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:40.812838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:40.813589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:40.814012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:40.940813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:40.948919 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:40.950686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:40.952739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-475838d0-8c8b-4dd5-b561-b4c701c32edd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.150952 May 11 09:54:40.953775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 216/432] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:40 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:41.972608 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:41.973218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:41.979482 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:41.979962 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:41.980761 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:41.981196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:42.106247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:42.114637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:42.116163 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:42.117313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7341ff3c-f3ff-49b9-b7be-4af8d6a190d7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.148667 May 11 09:54:42.117864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 217/433] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:41 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:54:43.136117 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:43.136728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:43.143231 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:43.143730 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:43.144501 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:43.144934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:43.276319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:43.280820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-aa24e2cc-5721-411d-a295-8bbda94326f4 req-1e4d36ce-1e0f-421d-ac49-3e9b431eb7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "name": "network-vif-plugged", "status": "completed", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:43.288290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:43.289311 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-aa24e2cc-5721-411d-a295-8bbda94326f4 req-1e4d36ce-1e0f-421d-ac49-3e9b431eb7f3 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:43.289752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-aa24e2cc-5721-411d-a295-8bbda94326f4 req-1e4d36ce-1e0f-421d-ac49-3e9b431eb7f3 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:43.289910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:43.291568 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93ca5083-bea5-4969-ab44-6db3c44c5989 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.159345 May 11 09:54:43.292321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 217/434] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:43 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:43.307022 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-aa24e2cc-5721-411d-a295-8bbda94326f4 req-1e4d36ce-1e0f-421d-ac49-3e9b431eb7f3 service nova] Creating event network-vif-plugged:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:54:43.312224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-aa24e2cc-5721-411d-a295-8bbda94326f4 req-1e4d36ce-1e0f-421d-ac49-3e9b431eb7f3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035526 May 11 09:54:43.312880 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 218/435] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:54:44.311460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:44.312092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:44.318551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:44.319022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:44.319813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:44.320245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:44.447235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:44.455358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:44.456894 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:44.458042 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24853323-f6b8-4005-870d-32114644b7fd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.151247 May 11 09:54:44.458598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 218/436] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:44 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:45.477780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:45.478466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:45.485194 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:45.485639 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:45.486405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:45.486859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:45.612535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:45.620830 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:45.622544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:45.623739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-16f13259-c06b-4bc4-aa42-a304dff21c3b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1808 microversion: 2.20 time: 0.150602 May 11 09:54:45.624307 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 219/437] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:45 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:46.642042 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:46.642638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:46.649044 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:46.649488 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:46.650243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:46.650668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:46.775557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:46.784192 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:46.785948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:46.787090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ce5fac19-42f1-449c-a73c-a27fe3c39a0d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1795 microversion: 2.20 time: 0.148978 May 11 09:54:46.787639 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 219/438] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:54:46 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1795 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:54:47.096432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d6d39e7-cf6b-4006-be06-b656ed6c5221"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:47.097530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:47.103919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:47.104372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:47.105235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:47.105666 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:47.350114 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b0b265e4-aeff-4fe7-bc5b-eac72fef44c4 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257015 May 11 09:54:47.350696 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 220/439] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:54:47 2022] POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:54:54.821699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:54:54.822719 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:54.829060 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:54.829504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:54.830270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:54.830706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:54.852094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'flavor' on Instance uuid b049ee4e-2e76-4831-9e10-da98d386dcb9 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:54:54.969681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0cc7ef9-f74b-4541-8909-577ed5ecffdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/action" status: 200 len: 32 microversion: 2.1 time: 0.151763 May 11 09:54:54.970360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 220/440] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:54:54 2022] POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:54:54.980652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:54.981356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:54.989038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:54.989479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:54.990244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:54.990675 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:55.128570 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:55.136244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4c5b52ab-53f4-434f-be3f-7b33da8a9601 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.160502 May 11 09:54:55.136804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 221/441] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:54 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:56.154209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:56.154905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:56.161706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:56.162151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:56.162909 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:56.163341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:56.292370 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:56.300559 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7399ea4c-da6a-4794-bdde-31ffbdc82fdd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.150628 May 11 09:54:56.301126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 221/442] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:56 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:57.317499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:57.318108 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:57.324593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:57.325046 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:57.325803 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:57.326238 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:57.446918 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:57.455090 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ebe9f8d4-657c-405b-b1e2-76551a13cc9f tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.141418 May 11 09:54:57.455645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 222/443] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:57 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:58.472059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:58.472574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:58.478885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:58.479330 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:58.480114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:58.480547 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:58.604075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:58.611801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-72c9a86e-26b7-4390-b813-5e100cfd9222 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.143695 May 11 09:54:58.612361 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 222/444] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:58 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:54:59.629253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:54:59.629835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:54:59.636122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:59.636571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:59.637332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:54:59.637768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:54:59.774091 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:54:59.782571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-23dc942c-4252-4706-aa19-0fd61a6998ee tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.157207 May 11 09:54:59.783154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 223/445] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:54:59 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:00.243234 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:00.243821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:00.250559 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:00.251002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:00.251801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:00.252236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:00.373842 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lazy-loading 'services' on Instance uuid 4b269761-570a-4253-866d-f35c6b8002bb {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:55:00.481022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0703f121-6798-445a-8106-fea0221f5d4f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments/7f66c90a-8ac8-463b-a759-0bc2f68b1b15" status: 202 len: 0 microversion: 2.1 time: 0.241545 May 11 09:55:00.481700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 223/446] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:55:00 2022] DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments/7f66c90a-8ac8-463b-a759-0bc2f68b1b15 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:55:00.800500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:00.801087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:00.807335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:00.807818 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:00.808580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:00.809014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:00.932066 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:00.940020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3ad6bc4e-9a64-4fd4-833a-5efbd0e450ad tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.143449 May 11 09:55:00.940587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 224/447] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:00 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:55:01.591632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0142941b-5554-43c0-b8a5-5eea285fcee2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:01.598954 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0142941b-5554-43c0-b8a5-5eea285fcee2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:01.599402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0142941b-5554-43c0-b8a5-5eea285fcee2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:01.620208 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0142941b-5554-43c0-b8a5-5eea285fcee2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Going to try to stop instance {{(pid=123392) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 11 09:55:01.660161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0142941b-5554-43c0-b8a5-5eea285fcee2 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action" status: 202 len: 0 microversion: 2.1 time: 0.072910 May 11 09:55:01.661014 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 224/448] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:55:01 2022] POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:55:01.669065 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:01.669680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:01.676329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:01.676329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:01.677126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:01.677472 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:01.802091 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:01.809808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9ddcf495-f67c-4408-80bb-8346085c49d0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.144547 May 11 09:55:01.810368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 225/449] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:01 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:01.957405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:01.958089 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:01.964703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:01.965147 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:01.965904 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:01.966334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:02.093036 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:02.100650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-87516b8b-a710-4c76-8ff4-5db71fb17449 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.147408 May 11 09:55:02.101244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 225/450] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:01 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:02.827836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:02.828376 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:02.834655 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:02.835102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:02.835889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:02.836321 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:02.962075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:02.970103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c8dae03a-a658-45fb-a7bd-f7300a92964c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.146678 May 11 09:55:02.970674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 226/451] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:02 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:03.118223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:03.118759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:03.125529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:03.125971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:03.126722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:03.127149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:03.255806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:03.263513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f02fece5-e6d8-4482-8fa3-c15440e19a7a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.149168 May 11 09:55:03.264875 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 226/452] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:03 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:03.987602 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:03.988251 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:03.994622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:03.995014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:03.995799 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:03.996235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:04.117743 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:04.125118 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-59049d75-a509-457a-9bf3-169b4a81efbd tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.141976 May 11 09:55:04.125683 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 227/453] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:03 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:04.280684 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:04.281226 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:04.287892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:04.288339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:04.289105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:04.289539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:04.410643 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:04.418802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2167fc46-5aa1-4c31-b2fd-172ee2220aa2 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.142113 May 11 09:55:04.419371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 227/454] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:04 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:05.142692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:05.143218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:05.149473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:05.149914 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:05.150672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:05.151096 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:05.278409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:05.286552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5936b14a-bf54-4757-86b6-eb321f824b8e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.148274 May 11 09:55:05.287108 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 228/455] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:05 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:05.436837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:05.437474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:05.443757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:05.444204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:05.444970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:05.445403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:05.571222 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:05.579456 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9a21b350-646e-430c-a794-b76dc9caa7aa tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.146959 May 11 09:55:05.580049 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 228/456] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:05 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:06.302725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:06.303336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:06.309654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:06.310108 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:06.310872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:06.311307 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:06.445822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:06.453719 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1737f5bb-be8e-47fe-b0b9-73f03817be17 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.154860 May 11 09:55:06.454286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 229/457] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:06 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:06.599092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:06.599740 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:06.606189 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:06.606638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:06.607405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:06.607869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:06.741000 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:06.748654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2b231a36-d6c3-4bb6-9263-84dec15ebb1b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.156097 May 11 09:55:06.749216 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 229/458] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:06 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:07.470718 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:07.471257 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:07.477591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:07.478032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:07.478789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:07.479221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:07.601126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:07.608915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ad0b59dd-4ebc-4f17-86fa-2c8c954965e5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.141546 May 11 09:55:07.609467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 230/459] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:07 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:07.765466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:07.766074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:07.772441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:07.772897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:07.773661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:07.774092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:07.899561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:07.907780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0c8cdc3b-44e6-47c5-9443-f77d506e8663 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.146191 May 11 09:55:07.908345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 230/460] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:07 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:08.626529 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:08.627059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:08.633335 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:08.633778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:08.634538 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:08.634965 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:08.759268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:08.766386 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a867d765-3a14-438c-9e68-d79d98e72406 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.144305 May 11 09:55:08.766943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 231/461] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:08 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:08.925292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:08.925923 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:08.932355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:08.932793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:08.933546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:08.933972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:09.056911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:09.065279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6667e0ac-e727-4bb6-bed4-47c4a50fbc1e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.143755 May 11 09:55:09.065837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 231/462] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:08 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:09.782173 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:09.783385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:09.789928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:09.790369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:09.791118 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:09.791547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:09.913375 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:09.920547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9ad7cf8a-3fa8-4cb8-8047-87a328abdbe7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.142171 May 11 09:55:09.921104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 232/463] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:09 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:10.082311 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:10.082866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:10.089505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:10.089960 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:10.090757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:10.091193 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:10.215196 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:10.223704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b3a7492-145b-4803-86af-f7131774b360 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.145368 May 11 09:55:10.224267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 232/464] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:10 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:10.937523 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:10.938154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:10.945034 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:10.945478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:10.946232 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:10.946660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:11.079420 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:11.086608 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-abe14b22-f878-4d0a-9471-e0b7dcbe9100 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1676 microversion: 2.1 time: 0.152889 May 11 09:55:11.087202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 233/465] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:10 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:11.240620 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:11.241217 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:11.247444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:11.247916 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:11.248666 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:11.249093 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:11.384434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:11.392275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b66f5421-6203-4a96-a8a7-a3c6c90d7ced tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.155480 May 11 09:55:11.392838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 233/466] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:11 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:12.103868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:12.104385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:12.110929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.111371 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.112182 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.112616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.240328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:12.247797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7c6a696a-3c88-4bc3-ba9b-f14de972e970 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1653 microversion: 2.1 time: 0.147859 May 11 09:55:12.248551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 234/467] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:12 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1653 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:12.264683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-013f098b-126b-43d4-957f-3020a1500432 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:12.271753 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013f098b-126b-43d4-957f-3020a1500432 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.272157 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-013f098b-126b-43d4-957f-3020a1500432 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.293490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-013f098b-126b-43d4-957f-3020a1500432 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Going to try to start instance {{(pid=123392) start /opt/stack/nova/nova/compute/api.py:2730}} May 11 09:55:12.338759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-013f098b-126b-43d4-957f-3020a1500432 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action" status: 202 len: 0 microversion: 2.1 time: 0.077805 May 11 09:55:12.339360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 234/468] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:55:12 2022] POST /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 09:55:12.347664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:12.348313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:12.354342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.354722 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.355476 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.355945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.408737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:12.409434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:12.415838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.416295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.417069 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:12.417505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:12.486317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:12.493650 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cc42a02a-b5fe-45db-acf3-698dfd85c9e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1662 microversion: 2.1 time: 0.149946 May 11 09:55:12.494221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 235/469] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:12 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1662 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:12.544010 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:12.552278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-103385f2-7fb1-443e-816e-773fa307706e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1735 microversion: 2.1 time: 0.147707 May 11 09:55:12.552841 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 235/470] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:12 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:55:13.511483 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:13.512303 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:13.518596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.519047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:13.519833 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.520260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:13.569441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:13.570024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:13.576345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.576793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:13.577565 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.577990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:13.647043 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:13.654403 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-af4e5620-7822-4742-a739-099e06b9869b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1662 microversion: 2.1 time: 0.146863 May 11 09:55:13.655192 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 236/471] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:13 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1662 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:13.767060 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:13.775002 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-43d287f0-4257-40fc-96c4-c269d1b20cb7 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1715 microversion: 2.1 time: 0.209445 May 11 09:55:13.775563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 236/472] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:13 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1715 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:55:13.875142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:13.875630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:13.881527 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.881974 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:13.882735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:13.883171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.003157 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] HTTP exception thrown: Cannot 'detach_volume' instance b049ee4e-2e76-4831-9e10-da98d386dcb9 while it is in vm_state rescued May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Request method failure captured: May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments/4d6d39e7-cf6b-4006-be06-b656ed6c5221 HTTP/1.1 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpVnFwjHwqwuobvyTiROm4k6LTpNK2ruFLnzVXHbHlU_TJpO7NlHLdT8nAoMQY5ZkcOZ0cUkBFL6H4NwAwWsvYcP3Q49AsXYZfuEPR4F3wuO9kvaqdZYL3daukv5VXh9diTFKRse-nuMXcJld28WgwhoRDPkZjXj17xm-CNUyjUYE May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:55:14.004777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8ac5dee78b854e3cbe6a7d8dbba88554", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 332b151b87ec412195fab910140cd163 May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:55:14.006397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Cannot 'detach_volume' instance b049ee4e-2e76-4831-9e10-da98d386dcb9 while it is in vm_state rescued May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'server_id': 'b049ee4e-2e76-4831-9e10-da98d386dcb9', 'id': '4d6d39e7-cf6b-4006-be06-b656ed6c5221'} May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:55:14.010112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b049ee4e-2e76-4831-9e10-da98d386dcb9 while it is in vm_state rescued May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b049ee4e-2e76-4831-9e10-da98d386dcb9 while it is in vm_state rescued May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:14.011547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Returning 409 to user: Cannot 'detach_volume' instance b049ee4e-2e76-4831-9e10-da98d386dcb9 while it is in vm_state rescued {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:55:14.012724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-81f7437b-dd35-4d44-a9d7-e07ed871f571 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments/4d6d39e7-cf6b-4006-be06-b656ed6c5221" status: 409 len: 152 microversion: 2.1 time: 0.134975 May 11 09:55:14.012724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 237/473] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:55:13 2022] DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments/4d6d39e7-cf6b-4006-be06-b656ed6c5221 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 11 09:55:14.015075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:14.015551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:14.022027 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.022479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.023271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.023726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.086502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6d39bfb9-783f-4b21-90f4-dad1507b722e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/action" status: 202 len: 0 microversion: 2.1 time: 0.075110 May 11 09:55:14.087123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 237/474] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:55:14 2022] POST /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:55:14.095909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:14.096605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:14.103169 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.103615 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.104427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.104862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.228225 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:14.235922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cfa192ea-7c83-4f33-b28d-269d5c4f6ee8 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1723 microversion: 2.1 time: 0.144376 May 11 09:55:14.236479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 238/475] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:14 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:14.673232 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:14.675653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:14.682805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.683197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.684239 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:14.684668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:14.901597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:14.909402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-859c7472-eb17-4abd-a979-fd164d607ede tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1666 microversion: 2.1 time: 0.240299 May 11 09:55:14.909964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 238/476] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:14 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1666 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:55:15.252497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:15.253121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:15.260287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:15.260735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:15.261495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:15.261922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:15.591850 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:15.600141 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-bbee285f-f7b3-4fec-8e99-79cb7dae1f47 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1723 microversion: 2.1 time: 0.351444 May 11 09:55:15.600709 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 239/477] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:15 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:16.617806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:16.618347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:16.624615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:16.625058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:16.625821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:16.626255 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:16.759351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:16.767060 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-577ce80f-40dc-4c8f-bef9-8a3f07a9257a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1723 microversion: 2.1 time: 0.153166 May 11 09:55:16.767631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 239/478] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:16 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:17.784682 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:17.785289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:17.791884 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:17.792332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:17.793092 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:17.793528 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:17.917375 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:17.925569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-21e424f5-5ca4-45e1-bbec-674bb3ea4301 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1729 microversion: 2.1 time: 0.145284 May 11 09:55:17.926125 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 240/479] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:17 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1729 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:17.942118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:17.942631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:17.948969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:17.949408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:17.950160 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:17.950583 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:18.023169 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-979ca48a-1477-4d0b-80ae-1f7c768f3c0d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085333 May 11 09:55:18.023783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 240/480] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:55:17 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:19.139521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-787e200c-2987-4db0-b8f4-73dfb845ff92 req-0c16218c-4543-46b3-bb1b-4d1234d745eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:19.149084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-787e200c-2987-4db0-b8f4-73dfb845ff92 req-0c16218c-4543-46b3-bb1b-4d1234d745eb service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:19.149623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-787e200c-2987-4db0-b8f4-73dfb845ff92 req-0c16218c-4543-46b3-bb1b-4d1234d745eb service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:19.160587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-787e200c-2987-4db0-b8f4-73dfb845ff92 req-0c16218c-4543-46b3-bb1b-4d1234d745eb service nova] Creating event network-changed:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:55:19.167410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-787e200c-2987-4db0-b8f4-73dfb845ff92 req-0c16218c-4543-46b3-bb1b-4d1234d745eb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031621 May 11 09:55:19.168150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 241/481] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:55:19.802494 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:19.803064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:19.808950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:19.809474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:19.810309 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:19.810834 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:19.838445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3a8dc0d2-0d60-48bb-a4e3-13f45354b317 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments/4bce0a5c-ef50-4c97-8fdb-1747d605496e" status: 200 len: 194 microversion: 2.20 time: 0.041032 May 11 09:55:19.839087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 241/482] 10.222.0.44 () {60 vars in 1453 bytes} [Wed May 11 09:55:19 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments/4bce0a5c-ef50-4c97-8fdb-1747d605496e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:55:19.901069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:19.901649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:19.908561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:19.909021 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:19.909800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:19.910238 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:19.989459 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lazy-loading 'services' on Instance uuid 171adcea-6dc1-4564-90ca-371a791011fa {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:55:20.101223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-057bb1e6-6cf0-46c8-9240-42d2a55d840d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments/4bce0a5c-ef50-4c97-8fdb-1747d605496e" status: 202 len: 0 microversion: 2.20 time: 0.204354 May 11 09:55:20.102173 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 242/483] 10.222.0.44 () {60 vars in 1456 bytes} [Wed May 11 09:55:19 2022] DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments/4bce0a5c-ef50-4c97-8fdb-1747d605496e => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:55:20.110343 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:20.111332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:20.117305 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:20.117746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:20.118504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:20.118931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:20.148143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-552c080b-52c6-4199-9242-a43d73f3d305 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041648 May 11 09:55:20.148693 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 242/484] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 09:55:20 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:55:21.160914 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:21.162244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:21.168787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.169224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.169974 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.170400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.182505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-b4a8649b-e093-47e6-9b90-700269b6360f req-2f6c3ced-8cb4-4e35-a5aa-ad45053ef837 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:21.191046 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b4a8649b-e093-47e6-9b90-700269b6360f req-2f6c3ced-8cb4-4e35-a5aa-ad45053ef837 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.191619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b4a8649b-e093-47e6-9b90-700269b6360f req-2f6c3ced-8cb4-4e35-a5aa-ad45053ef837 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.199575 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b512f2ba-b22e-46ab-9e5f-e15b79bdaf4c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043513 May 11 09:55:21.200186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 243/485] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 09:55:21 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:21.202738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-b4a8649b-e093-47e6-9b90-700269b6360f req-2f6c3ced-8cb4-4e35-a5aa-ad45053ef837 service nova] Creating event network-changed:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:55:21.207601 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-b4a8649b-e093-47e6-9b90-700269b6360f req-2f6c3ced-8cb4-4e35-a5aa-ad45053ef837 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028709 May 11 09:55:21.208523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 243/486] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:55:21.257020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:21.257519 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:21.263339 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.263821 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.264584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.265018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.290924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:55:21.367893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b6584394-2046-4e62-8b5d-8db4c3646075 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 204 len: 0 microversion: 2.20 time: 0.114226 May 11 09:55:21.368826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 244/487] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 09:55:21 2022] DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 09:55:21.377735 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:21.378431 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:21.384572 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.385019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.385783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:21.386228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:21.511153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:21.519358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:21.520905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:21.522051 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-714af135-1eaf-4077-a572-b6e3af817a84 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.148645 May 11 09:55:21.522633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 244/488] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:21 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:55:22.541181 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:22.541800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:22.548030 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:22.548481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:22.549248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:22.549682 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:22.676747 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:22.684447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:22.685964 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:22.687119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-462900c3-9043-4181-8d50-874a0b80d08b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1723 microversion: 2.20 time: 0.150497 May 11 09:55:22.687683 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 245/489] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:22 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:23.706176 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:23.706779 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:23.713191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:23.713638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:23.714408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:23.714837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:23.803084 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:23.813453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:23.816035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:23.817333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-089b0a64-613e-4e8c-9071-e08097a8d039 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 200 len: 1655 microversion: 2.20 time: 0.115206 May 11 09:55:23.818173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 245/490] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:23 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 1655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:24.236987 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-02c3a420-e4c0-4fa5-9e44-5824dd1cde51 req-fe9a3ad9-2fde-4276-b5b9-d88ab5727f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "171adcea-6dc1-4564-90ca-371a791011fa", "name": "network-vif-deleted", "tag": "955faab1-2867-4868-b955-3797e7b1bc28"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:24.258299 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-02c3a420-e4c0-4fa5-9e44-5824dd1cde51 req-fe9a3ad9-2fde-4276-b5b9-d88ab5727f44 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:24.259479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-02c3a420-e4c0-4fa5-9e44-5824dd1cde51 req-fe9a3ad9-2fde-4276-b5b9-d88ab5727f44 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:24.272831 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-02c3a420-e4c0-4fa5-9e44-5824dd1cde51 req-fe9a3ad9-2fde-4276-b5b9-d88ab5727f44 service nova] Creating event network-vif-deleted:955faab1-2867-4868-b955-3797e7b1bc28 for instance 171adcea-6dc1-4564-90ca-371a791011fa on hv-cinder-83699 May 11 09:55:24.279210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-02c3a420-e4c0-4fa5-9e44-5824dd1cde51 req-fe9a3ad9-2fde-4276-b5b9-d88ab5727f44 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045868 May 11 09:55:24.284003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 246/491] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:24.835463 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:24.836068 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:24.842504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:24.842956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:24.843752 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:24.844192 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:24.858660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa HTTP/1.1 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:55:24.860333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:55:24.862416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '171adcea-6dc1-4564-90ca-371a791011fa'} May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:55:24.863156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:55:24.865240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:24.867448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:55:24.867448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5a065770-4998-4d87-8597-99ca7423cf33 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 404 len: 111 microversion: 2.20 time: 0.030915 May 11 09:55:24.867448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 246/492] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:24 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 09:55:24.872638 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2efe6627-1743-47fd-84d8-6d16d615784c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '.version_select at 0x7f8bcd5ed0d0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:24.896674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2efe6627-1743-47fd-84d8-6d16d615784c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897439397" status: 204 len: 0 microversion: 2.20 time: 0.028688 May 11 09:55:24.901499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 247/493] 10.222.0.44 () {60 vars in 1258 bytes} [Wed May 11 09:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897439397 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 09:55:25.586048 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a4de9c84-8662-45db-88f0-1afa35b74b79 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: .version_select at 0x7f8bcd839c10>, body: {"keypair": {"name": "tempest-keypair-1337647994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHy+Z6WPc3rpdduSU6Alr+5DymCwACWScYiV5Yzyqb/BwRk2xeYc+9XVXQXLuO1pJJZIgZmWuhI8IAZ+ebS17jWYYaB146heKibcYMAScYiJ3f0EfTJYIpf0Lk133gAhg=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:25.603996 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-a4de9c84-8662-45db-88f0-1afa35b74b79 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:55:25.607794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-a4de9c84-8662-45db-88f0-1afa35b74b79 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for user a918dc4737544f3fa38090e2c82aeae6 and project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:55:25.644900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a4de9c84-8662-45db-88f0-1afa35b74b79 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.062568 May 11 09:55:25.645623 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 247/494] 10.222.0.44 () {62 vars in 1199 bytes} [Wed May 11 09:55:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 11 09:55:26.950517 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-14101446", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9f65fec-6ab4-477b-8f01-74708a6b7e82"}], "security_groups": [{"name": "tempest-securitygroup--719578818"}], "key_name": "tempest-keypair-1337647994", "user_data": "}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:27.050977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] validate_networks() for [('c9f65fec-6ab4-477b-8f01-74708a6b7e82', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:55:27.404530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:55:27.405088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:55:27.405563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:55:27.405971 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:55:27.406382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:55:27.416136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:27.416582 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:27.417378 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:27.417841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:27.433669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:55:27.437493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Getting quotas for user a918dc4737544f3fa38090e2c82aeae6 and project 6e16bff4d8934820afea7d3345bcdc4f. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:55:27.448003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:55:27.450306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:55:27.495085 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a5099019-9188-45cf-b62d-8044dbe07fcf tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.553939 May 11 09:55:27.495745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 248/495] 10.222.0.44 () {62 vars in 1187 bytes} [Wed May 11 09:55:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 11 09:55:27.506560 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:27.507162 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:27.559150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:27.567323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:27.568853 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:27.569971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e3f3587a-4aa6-48c8-bb90-e86dcfcbc2ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1280 microversion: 2.20 time: 0.067957 May 11 09:55:27.579142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 248/496] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:27 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:28.588847 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:28.589526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:28.596207 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:28.596650 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:28.597407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:28.597837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:28.656953 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:28.665535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:28.667180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:28.668299 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3e2ca2db-c5a2-4d3a-b5c2-a833b33aed61 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1338 microversion: 2.20 time: 0.083824 May 11 09:55:28.668855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 249/497] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:28 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1338 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:29.686680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:29.687183 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:29.694193 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:29.694645 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:29.695446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:29.695878 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:29.877453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-e24acc48-3b2b-44e5-8f6f-84ed41f2c236 req-2ce9a5a1-493d-4ab6-b94d-d4d96721f91d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:29.888760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-e24acc48-3b2b-44e5-8f6f-84ed41f2c236 req-2ce9a5a1-493d-4ab6-b94d-d4d96721f91d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:29.889500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-e24acc48-3b2b-44e5-8f6f-84ed41f2c236 req-2ce9a5a1-493d-4ab6-b94d-d4d96721f91d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:29.901928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-e24acc48-3b2b-44e5-8f6f-84ed41f2c236 req-2ce9a5a1-493d-4ab6-b94d-d4d96721f91d service nova] Creating event network-changed:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:55:29.909498 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:29.918292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-e24acc48-3b2b-44e5-8f6f-84ed41f2c236 req-2ce9a5a1-493d-4ab6-b94d-d4d96721f91d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041049 May 11 09:55:29.920368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:29.921882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:29.922332 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 250/498] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:29.923664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-685d7e26-188c-439f-a3ba-a5e0908d86de tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.241084 May 11 09:55:29.924506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 249/499] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:29 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:30.943032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:30.943736 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:30.949923 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:30.950370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:30.951133 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:30.951566 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:31.073111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:31.081427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:31.082918 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:31.084021 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9302fa50-f2ba-49f1-9b40-0f2d226c36fe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.146132 May 11 09:55:31.084578 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 251/500] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:30 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:32.102106 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:32.102725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:32.108630 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:32.109070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:32.109823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:32.110251 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:32.244160 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:32.251785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:32.253268 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:32.254345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-08d4d880-c295-427b-adcc-49975ad6484b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.156310 May 11 09:55:32.254894 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 250/501] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:32 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:33.271920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:33.272545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:33.279179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:33.279625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:33.280408 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:33.280835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:33.408297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:33.416856 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:33.418357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:33.419447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6d8030d0-2399-4762-b2d3-251fe9a31825 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.151476 May 11 09:55:33.420019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 252/502] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:33 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:34.437136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:34.437748 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:34.444140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:34.444596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:34.445393 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:34.445829 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:34.572292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:34.579980 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:34.582105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:34.583202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76e6841e-a7c1-46e2-8734-90acda208ffe tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.149955 May 11 09:55:34.583766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 251/503] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:34 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:35.586274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-1503e159-8a2b-494b-a715-7042542e426b req-402385a7-405b-4fd1-9c27-27a55ab5e8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:35.594438 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-1503e159-8a2b-494b-a715-7042542e426b req-402385a7-405b-4fd1-9c27-27a55ab5e8dc service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:35.595124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-1503e159-8a2b-494b-a715-7042542e426b req-402385a7-405b-4fd1-9c27-27a55ab5e8dc service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:35.600838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:35.601460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:35.606101 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-1503e159-8a2b-494b-a715-7042542e426b req-402385a7-405b-4fd1-9c27-27a55ab5e8dc service nova] Creating event network-vif-plugged:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:55:35.608915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:35.610059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:35.610913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-1503e159-8a2b-494b-a715-7042542e426b req-402385a7-405b-4fd1-9c27-27a55ab5e8dc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028363 May 11 09:55:35.611211 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:35.611555 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 253/504] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:35.611960 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:35.765866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:35.773942 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:35.775426 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:35.776557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3290ec45-69cf-430e-8156-e5548d023720 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.179651 May 11 09:55:35.777255 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 252/505] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:35 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:55:36.795577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:36.796282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:36.802456 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:36.802900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:36.803663 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:36.804124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:36.929740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:36.937422 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:36.938921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:36.940556 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6bf08f45-6ac0-4479-9958-ee13b2fbffae tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1405 microversion: 2.20 time: 0.149168 May 11 09:55:36.941110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 254/506] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:36 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:37.958266 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:37.958903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:37.965257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:37.965705 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:37.966470 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:37.966910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:38.090650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:38.098403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:38.099942 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:38.101093 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d16026cb-d97f-45a1-af1d-d83990acff32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1596 microversion: 2.20 time: 0.146788 May 11 09:55:38.101643 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 253/507] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:55:37 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1596 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:55:38.118727 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:38.119236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:38.125473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:38.125919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:38.126674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:38.127107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:38.201047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cd8b1496-c09f-4ea1-bb56-7c97852f1e21 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086129 May 11 09:55:38.201647 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 255/508] 10.222.0.44 () {60 vars in 1315 bytes} [Wed May 11 09:55:38 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:55:39.345302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-fd61f220-a499-48dd-b2cf-1ef6033fd992 req-a619f525-1991-487c-908c-6792d3ed1b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:39.354056 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-fd61f220-a499-48dd-b2cf-1ef6033fd992 req-a619f525-1991-487c-908c-6792d3ed1b38 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:39.354569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-fd61f220-a499-48dd-b2cf-1ef6033fd992 req-a619f525-1991-487c-908c-6792d3ed1b38 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:39.365919 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-fd61f220-a499-48dd-b2cf-1ef6033fd992 req-a619f525-1991-487c-908c-6792d3ed1b38 service nova] Creating event network-changed:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:55:39.370914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-fd61f220-a499-48dd-b2cf-1ef6033fd992 req-a619f525-1991-487c-908c-6792d3ed1b38 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029250 May 11 09:55:39.371582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 254/509] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:50.033114 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:50.034019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:50.040234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.040595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.042367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.042807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.072014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c7444871-6047-4378-8bb7-6152e994908e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043390 May 11 09:55:50.072571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 256/510] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:55:50 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:55:50.127993 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:50.129397 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:50.135895 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.136339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.137096 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.137524 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.161837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:55:50.241405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d47d4437-4c0d-44b0-b6e3-2463e3b13b24 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 204 len: 0 microversion: 2.1 time: 0.117238 May 11 09:55:50.242143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 255/511] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:55:50 2022] DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:55:50.250595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:50.251208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:50.257614 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.258056 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.258811 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:50.259249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:50.379587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:50.386748 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b4590bd4-9761-4101-b306-1bb1b89270cc tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1672 microversion: 2.1 time: 0.140139 May 11 09:55:50.387310 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 257/512] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:50 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1672 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:51.010382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:51.010955 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:51.016755 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.017204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.017961 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.018392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.098224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'services' on Instance uuid b049ee4e-2e76-4831-9e10-da98d386dcb9 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:55:51.166196 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7633901-7c4b-4204-885f-2b88960f40fd tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments/4d6d39e7-cf6b-4006-be06-b656ed6c5221" status: 202 len: 0 microversion: 2.1 time: 0.159868 May 11 09:55:51.166817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 256/513] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:55:51 2022] DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments/4d6d39e7-cf6b-4006-be06-b656ed6c5221 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:55:51.175788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:51.176704 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:51.182895 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.183339 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.184130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.184564 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.212462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b66fbd14-8c78-44c8-aa21-4c9a66ad97b0 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041014 May 11 09:55:51.212945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 258/514] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:55:51 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:51.404632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:51.405324 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:51.412238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.412681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.413444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:51.414129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:51.537877 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:51.545407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cb5e897e-c8a1-454f-959c-ab82d270ae0e tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1672 microversion: 2.1 time: 0.145279 May 11 09:55:51.545965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 257/515] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:51 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1672 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:52.224778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:52.225758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:52.232358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:52.232813 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:52.233581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:52.234020 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:52.262454 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f55a5766-f45c-4313-a70a-b8d9b783266c tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042330 May 11 09:55:52.263012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 259/516] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:55:52 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:52.562364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:52.562892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:52.569629 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:52.570066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:52.570837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:52.571282 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:52.988840 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:52.996664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-391024b2-4a09-4ce4-9f93-01951eb1e064 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1672 microversion: 2.1 time: 0.438108 May 11 09:55:52.997171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 258/517] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:52 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1672 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:53.273973 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:53.274907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:53.281109 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.281550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.282299 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.282726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.311333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a182e9a3-400d-4d95-be17-002922923c3d tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041286 May 11 09:55:53.311915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 260/518] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:55:53 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:55:53.378206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:53.378691 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:53.384465 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.384909 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.385671 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.386101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.411575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:55:53.487507 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-23575e06-c735-4917-9fc2-8e592d50ac79 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 204 len: 0 microversion: 2.1 time: 0.112963 May 11 09:55:53.488724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 259/519] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:55:53 2022] DELETE /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:55:53.496612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:53.497215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:53.503300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.503797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.505004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.505325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.638447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:53.646382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fa4f6828-f833-4116-b497-7b798fe3b053 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1689 microversion: 2.1 time: 0.153581 May 11 09:55:53.646945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 261/520] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:53 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:55:53.795828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-538b4687-0e21-4d26-ad1f-9eb678a4a415 req-c77db164-5b2e-4137-90f6-dd063ca85322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b269761-570a-4253-866d-f35c6b8002bb", "name": "network-vif-deleted", "tag": "df2abd79-668f-498d-a57f-5e550ea880ea"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:53.804917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-538b4687-0e21-4d26-ad1f-9eb678a4a415 req-c77db164-5b2e-4137-90f6-dd063ca85322 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:53.805425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-538b4687-0e21-4d26-ad1f-9eb678a4a415 req-c77db164-5b2e-4137-90f6-dd063ca85322 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:53.816702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-538b4687-0e21-4d26-ad1f-9eb678a4a415 req-c77db164-5b2e-4137-90f6-dd063ca85322 service nova] Creating event network-vif-deleted:df2abd79-668f-498d-a57f-5e550ea880ea for instance 4b269761-570a-4253-866d-f35c6b8002bb on hv-cinder-83699 May 11 09:55:53.821563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-538b4687-0e21-4d26-ad1f-9eb678a4a415 req-c77db164-5b2e-4137-90f6-dd063ca85322 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029654 May 11 09:55:53.822309 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 260/521] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:54.014236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:54.014849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:54.021243 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:54.021693 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:54.022466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:54.022895 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:54.089724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:54.097240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-440d58f0-f245-432e-a3b9-66a4609a50e3 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1605 microversion: 2.1 time: 0.086808 May 11 09:55:54.098001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 262/522] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:54 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1605 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:54.664235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:54.664946 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:54.670977 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:54.671429 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:54.672246 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:54.672683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:54.804104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:54.812770 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4afd561e-9977-4212-8615-f7dd3e5b8228 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1689 microversion: 2.1 time: 0.153079 May 11 09:55:54.813334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 261/523] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:54 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:55.114866 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:55.115429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:55.121709 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:55.122160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:55.122917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:55.123348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:55.181891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:55.189134 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-90a1646b-33dd-4b42-8378-ff5208372eae tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1605 microversion: 2.1 time: 0.078731 May 11 09:55:55.189700 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 263/524] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:55 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1605 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:55.829586 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:55.830197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:55.836582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:55.837062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:55.837823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:55.838259 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:55.965794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:55.973710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b40d232-e534-4512-a33a-fc17f8f4b309 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1689 microversion: 2.1 time: 0.147943 May 11 09:55:55.974274 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 262/525] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:55 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1689 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:56.205826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:56.206431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:56.213398 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:56.213842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:56.214601 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:56.215027 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:56.274478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:56.281632 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8433f940-8aa2-4bf2-820a-ef54dadf4629 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 200 len: 1605 microversion: 2.1 time: 0.079611 May 11 09:55:56.282183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 264/526] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:56 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 1605 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:56.990416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:56.991083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:56.997667 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:56.998119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:56.998907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:56.999344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:57.163308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:57.171402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a9b19dbc-3aea-409e-b9d4-26e3310415dc tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1689 microversion: 2.1 time: 0.185156 May 11 09:55:57.172011 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 263/527] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:56 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:57.299397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:57.300058 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:57.306922 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:57.307369 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:57.308164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:57.308593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:57.321673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb HTTP/1.1 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:55:57.323326 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:55:57.324745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '4b269761-570a-4253-866d-f35c6b8002bb'} May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:55:57.325510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:55:57.326786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:55:57.327884 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:55:57.327884 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c4db70d4-3c8b-46e4-be2c-d758b5d13509 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 404 len: 111 microversion: 2.1 time: 0.029242 May 11 09:55:57.328567 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 265/528] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:57 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:55:57.333550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2d50cea6-c375-48bb-8121-dc2b36454130 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '.version_select at 0x7f8bcd6ad3a0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:57.351915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2d50cea6-c375-48bb-8121-dc2b36454130 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975583261" status: 202 len: 0 microversion: 2.1 time: 0.022146 May 11 09:55:57.352488 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 264/529] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 09:55:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1975583261 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 09:55:57.976900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9d255e3f-71cf-4b0c-ad64-0064caed2be1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: .version_select at 0x7f8bcd4973a0>, body: {"keypair": {"name": "tempest-keypair-422797405", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGE/O++Rgm/4l9sqnS2a/pYwrJh6QXkDRgjf2G7MNGA9OA6IedVpReCRY7Ne7Zev88R4tOaY3sOueMRbCfjM8hnJAQO9R5nrDaD+pnSFPAZi6GQCk9CT/8J8UWzeWLhcg=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:57.990766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-9d255e3f-71cf-4b0c-ad64-0064caed2be1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for project d559012f039049b98f84658174e6f125. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:55:57.994674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-9d255e3f-71cf-4b0c-ad64-0064caed2be1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for user 0a535775680c46b7bd5b8348ee0a3a25 and project d559012f039049b98f84658174e6f125. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:55:58.001610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-7a691da0-c0d4-46ed-a561-7be347b0f032 req-eeb43bab-0b8c-4232-ae53-f67a2611068f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b049ee4e-2e76-4831-9e10-da98d386dcb9", "name": "network-vif-deleted", "tag": "628c4990-e252-4d43-a131-aca8b0889939"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:58.016067 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7a691da0-c0d4-46ed-a561-7be347b0f032 req-eeb43bab-0b8c-4232-ae53-f67a2611068f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:58.016526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7a691da0-c0d4-46ed-a561-7be347b0f032 req-eeb43bab-0b8c-4232-ae53-f67a2611068f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:58.031803 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9d255e3f-71cf-4b0c-ad64-0064caed2be1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058620 May 11 09:55:58.040415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 266/530] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:55:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:58.040605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-7a691da0-c0d4-46ed-a561-7be347b0f032 req-eeb43bab-0b8c-4232-ae53-f67a2611068f service nova] Creating event network-vif-deleted:628c4990-e252-4d43-a131-aca8b0889939 for instance b049ee4e-2e76-4831-9e10-da98d386dcb9 on hv-cinder-83699 May 11 09:55:58.040605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-7a691da0-c0d4-46ed-a561-7be347b0f032 req-eeb43bab-0b8c-4232-ae53-f67a2611068f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042347 May 11 09:55:58.040829 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 265/531] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:55:58.189264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:58.190730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:58.198447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:58.199275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:58.200415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:58.201073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:58.255328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:58.255936 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:58.256264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'fault' on Instance uuid b049ee4e-2e76-4831-9e10-da98d386dcb9 {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:55:58.310839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:55:58.319733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-aef0195c-7b45-43c1-b5d3-513ec298c471 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 200 len: 1334 microversion: 2.1 time: 0.134690 May 11 09:55:58.321180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 267/532] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:58 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:55:59.340226 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:59.341011 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: b049ee4e-2e76-4831-9e10-da98d386dcb9] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:55:59.347885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:59.348191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:59.349033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:59.349529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:59.362764 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] HTTP exception thrown: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Request method failure captured: May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 HTTP/1.1 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cpVnFwjHwqwuobvyTiROm4k6LTpNK2ruFLnzVXHbHlU_TJpO7NlHLdT8nAoMQY5ZkcOZ0cUkBFL6H4NwAwWsvYcP3Q49AsXYZfuEPR4F3wuO9kvaqdZYL3daukv5VXh9diTFKRse-nuMXcJld28WgwhoRDPkZjXj17xm-CNUyjUYE May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:55:59.364505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8ac5dee78b854e3cbe6a7d8dbba88554", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 332b151b87ec412195fab910140cd163 May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. May 11 09:55:59.365990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'b049ee4e-2e76-4831-9e10-da98d386dcb9'} May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:55:59.367038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. May 11 09:55:59.368448 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:55:59.369700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Returning 404 to user: Instance b049ee4e-2e76-4831-9e10-da98d386dcb9 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:55:59.369700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fdee66ab-c349-4419-8239-6313ead9a33b tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9" status: 404 len: 111 microversion: 2.1 time: 0.033064 May 11 09:55:59.370536 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 266/533] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:55:59 2022] GET /compute/v2.1/servers/b049ee4e-2e76-4831-9e10-da98d386dcb9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:55:59.377414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c61fc754-7c0f-4264-bb47-09bb13db71c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '.version_select at 0x7f8bcd497310>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:55:59.396717 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c61fc754-7c0f-4264-bb47-09bb13db71c3 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-14458741" status: 202 len: 0 microversion: 2.1 time: 0.023267 May 11 09:55:59.397391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 268/534] 10.222.0.44 () {58 vars in 1214 bytes} [Wed May 11 09:55:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-14458741 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:55:59.432154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-131169596", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a36be11-c66f-415c-98d4-0d4e370da946"}], "security_groups": [{"name": "tempest-securitygroup--50470728"}], "key_name": "tempest-keypair-422797405", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:55:59.553341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] validate_networks() for [('6a36be11-c66f-415c-98d4-0d4e370da946', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:55:59.933055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:55:59.933481 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:55:59.933967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:55:59.934438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:55:59.934855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:55:59.943785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:59.944240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:59.945049 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:55:59.945491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:55:59.962530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for project d559012f039049b98f84658174e6f125. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:55:59.966668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Getting quotas for user 0a535775680c46b7bd5b8348ee0a3a25 and project d559012f039049b98f84658174e6f125. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:55:59.978455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:55:59.980822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:56:00.028709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1687be0d-0f2f-48fa-8c89-335650037218 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.601465 May 11 09:56:00.034349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 267/535] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:55:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:56:00.041716 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6cad280b-f10e-45c1-be8d-8a613b5abeba tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:00.042411 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6cad280b-f10e-45c1-be8d-8a613b5abeba tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:00.109442 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6cad280b-f10e-45c1-be8d-8a613b5abeba tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:00.116970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6cad280b-f10e-45c1-be8d-8a613b5abeba tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1236 microversion: 2.1 time: 0.079829 May 11 09:56:00.117561 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 269/536] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:00 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:01.134998 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:01.135604 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:01.141647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:01.142099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:01.142878 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:01.143350 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:01.214816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:01.222683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dce29417-15b9-43a0-a7fc-23d2fdcb09db tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1294 microversion: 2.1 time: 0.092089 May 11 09:56:01.223310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 268/537] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:01 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:02.240315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:02.241029 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:02.247919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.248447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.249298 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.249820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.298349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-299f30a9-5c58-4e55-83d8-6b2a87e8b1fe req-5130f52d-5363-4339-ad52-de15bad42930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbbf608-e664-442c-8b03-e59f4ecd492e", "tag": "4101ae28-9733-441a-b102-4ff98e2e80e7"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:02.311736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-299f30a9-5c58-4e55-83d8-6b2a87e8b1fe req-5130f52d-5363-4339-ad52-de15bad42930 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.315587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-299f30a9-5c58-4e55-83d8-6b2a87e8b1fe req-5130f52d-5363-4339-ad52-de15bad42930 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.333775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-299f30a9-5c58-4e55-83d8-6b2a87e8b1fe req-5130f52d-5363-4339-ad52-de15bad42930 service nova] Creating event network-changed:4101ae28-9733-441a-b102-4ff98e2e80e7 for instance fcbbf608-e664-442c-8b03-e59f4ecd492e on hv-cinder-83699 May 11 09:56:02.337185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-299f30a9-5c58-4e55-83d8-6b2a87e8b1fe req-5130f52d-5363-4339-ad52-de15bad42930 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042372 May 11 09:56:02.337976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 269/538] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:56:02.344291 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:02.345049 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:02.357749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.358202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.358996 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.359427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.386274 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:56:02.421577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:02.429658 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1aee5073-2ac3-48b2-bad8-c187d5a5e225 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.193814 May 11 09:56:02.430274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 270/539] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:02 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:02.483921 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-12d94e47-f7c9-430f-ae47-e3053f7af479 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 204 len: 0 microversion: 2.1 time: 0.144363 May 11 09:56:02.484804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 270/540] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:56:02 2022] DELETE /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:56:02.494232 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:02.494232 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:02.507147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.507595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.508610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:02.509231 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:02.638124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:02.646039 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a27fff74-7427-4fd4-b7cc-e3ecd54c068e tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1507 microversion: 2.1 time: 0.156947 May 11 09:56:02.646605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 271/541] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:02 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:03.447369 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:03.448010 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:03.454258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:03.454701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:03.455459 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:03.455932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:03.584280 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:03.591462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-336281a9-6221-4da9-8dd5-ebe204eb1605 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.148435 May 11 09:56:03.592067 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 271/542] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:03 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:03.663124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:03.663753 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:03.670560 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:03.671002 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:03.671773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:03.672208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:03.794263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:03.801392 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ce0da86f-6166-46f9-b57d-1c267199a9ec tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1507 microversion: 2.1 time: 0.142755 May 11 09:56:03.801986 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 272/543] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:03 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1507 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:04.608965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:04.609516 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:04.616692 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:04.617141 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:04.617928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:04.618357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:04.818304 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:04.818911 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:04.825203 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:04.825649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:04.826407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:04.826838 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:04.952736 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:04.956126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:04.960927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2bb6aa8-c26c-4152-bb31-c0ecdd404e41 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.355850 May 11 09:56:04.961505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 272/544] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:04 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:04.965539 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ebc102b9-0e44-4799-8bb0-224b8212c5ca tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1507 microversion: 2.1 time: 0.151055 May 11 09:56:04.966268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 273/545] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:04 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:05.310108 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-5fff3e59-69ff-4837-be84-588f3c99253a req-71a8f5ca-c277-4d33-963a-59b3f443d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a9cc23-65c2-44b7-82fd-3231b125d573", "name": "network-vif-deleted", "tag": "97f449d2-6543-4043-95ca-0c159dc1eb8f"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:05.318748 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5fff3e59-69ff-4837-be84-588f3c99253a req-71a8f5ca-c277-4d33-963a-59b3f443d8f4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:05.319184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5fff3e59-69ff-4837-be84-588f3c99253a req-71a8f5ca-c277-4d33-963a-59b3f443d8f4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:05.329980 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-5fff3e59-69ff-4837-be84-588f3c99253a req-71a8f5ca-c277-4d33-963a-59b3f443d8f4 service nova] Creating event network-vif-deleted:97f449d2-6543-4043-95ca-0c159dc1eb8f for instance 12a9cc23-65c2-44b7-82fd-3231b125d573 on hv-cinder-83699 May 11 09:56:05.335267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-5fff3e59-69ff-4837-be84-588f3c99253a req-71a8f5ca-c277-4d33-963a-59b3f443d8f4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 May 11 09:56:05.336039 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 273/546] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:05.983059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:05.985722 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:05.986340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:05.989490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:05.995143 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:05.995592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:05.996332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:05.996462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:05.996810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:05.996920 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:05.997838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:05.998332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:06.029847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:06.030295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:06.030741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lazy-loading 'fault' on Instance uuid 12a9cc23-65c2-44b7-82fd-3231b125d573 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:56:06.071357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:06.079020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c4a3715e-8ec4-4ba3-8f8f-fd0c41db0232 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 200 len: 1311 microversion: 2.1 time: 0.100619 May 11 09:56:06.079586 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 274/547] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:05 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:06.122692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:06.130356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6cc7fd96-e073-433c-9626-83e229e339e6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.155614 May 11 09:56:06.130915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 274/548] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:05 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:07.096370 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:07.097020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 12a9cc23-65c2-44b7-82fd-3231b125d573] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:07.103887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.104341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.105118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.105556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.119072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] HTTP exception thrown: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Request method failure captured: May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 HTTP/1.1 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cpVnFwjHwqwuobvyTiROm4k6LTpNK2ruFLnzVXHbHlU_TJpO7NlHLdT8nAoMQY5ZkcOZ0cUkBFL6H4NwAwWsvYcP3Q49AsXYZfuEPR4F3wuO9kvaqdZYL3daukv5VXh9diTFKRse-nuMXcJld28WgwhoRDPkZjXj17xm-CNUyjUYE May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:56:07.120729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8ac5dee78b854e3cbe6a7d8dbba88554", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 332b151b87ec412195fab910140cd163 May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. May 11 09:56:07.122273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '12a9cc23-65c2-44b7-82fd-3231b125d573'} May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:56:07.123244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. May 11 09:56:07.124848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:56:07.126271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Returning 404 to user: Instance 12a9cc23-65c2-44b7-82fd-3231b125d573 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:56:07.126271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-67a8e13d-5677-42eb-831a-9fb1dd5ccd33 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573" status: 404 len: 111 microversion: 2.1 time: 0.029609 May 11 09:56:07.126271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 275/549] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:07 2022] GET /compute/v2.1/servers/12a9cc23-65c2-44b7-82fd-3231b125d573 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:56:07.130756 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:07.131248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:07.137642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.138077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.138836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.139266 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.147003 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:07.147613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:07.153514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.153943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.154722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.155160 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.169621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:56:07.258846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1eff4dad-641f-4570-a023-cd9da212890a tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 204 len: 0 microversion: 2.1 time: 0.131580 May 11 09:56:07.259787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 275/550] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:56:07 2022] DELETE /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:56:07.269191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:07.270397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:07.276664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.277101 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.277903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:07.278334 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:07.295080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:07.302772 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-69f8ade7-f75e-4458-8e11-684f8461ec90 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.160457 May 11 09:56:07.303353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 276/551] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:07 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:07.425177 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:07.433285 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7605eac1-cc98-4693-9270-a94b17482726 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.168363 May 11 09:56:07.434137 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 276/552] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:07 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:08.320610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:08.321144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:08.327703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:08.328154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:08.328910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:08.329341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:08.449828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:08.450430 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:08.456253 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:08.456693 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:08.457139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:08.458544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:08.458971 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:08.464143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-35f8fecf-eed2-4825-9f9b-20eade714ff6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.147921 May 11 09:56:08.464943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 277/553] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:08 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:08.583410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:08.590542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-af41e530-e1ea-45d4-b07e-99ca6f585ecb tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.144592 May 11 09:56:08.591099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 277/554] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:08 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:09.480885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:09.481425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:09.487727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:09.488180 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:09.489455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:09.489887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:09.606175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:09.606908 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:09.613274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:09.613438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:09.613727 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:09.615003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:09.615441 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:09.621137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-de8dd9e4-c3d0-47e9-bd3f-8e841479d960 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.144183 May 11 09:56:09.621706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 278/555] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:09 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:09.749725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:09.758849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f6bbecc0-aeb6-4c23-97ca-971f483ae5ce tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1521 microversion: 2.1 time: 0.156465 May 11 09:56:09.759912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 278/556] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:09 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:09.797671 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-bb41cfb8-75ba-421b-aabe-3a06a8ce8ec5 req-bc69b560-d66c-48e1-889c-a902fe708ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbbf608-e664-442c-8b03-e59f4ecd492e", "name": "network-vif-plugged", "status": "completed", "tag": "4101ae28-9733-441a-b102-4ff98e2e80e7"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:09.807064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-bb41cfb8-75ba-421b-aabe-3a06a8ce8ec5 req-bc69b560-d66c-48e1-889c-a902fe708ffc service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:09.807589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-bb41cfb8-75ba-421b-aabe-3a06a8ce8ec5 req-bc69b560-d66c-48e1-889c-a902fe708ffc service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:09.818839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-bb41cfb8-75ba-421b-aabe-3a06a8ce8ec5 req-bc69b560-d66c-48e1-889c-a902fe708ffc service nova] Creating event network-vif-plugged:4101ae28-9733-441a-b102-4ff98e2e80e7 for instance fcbbf608-e664-442c-8b03-e59f4ecd492e on hv-cinder-83699 May 11 09:56:09.823735 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-bb41cfb8-75ba-421b-aabe-3a06a8ce8ec5 req-bc69b560-d66c-48e1-889c-a902fe708ffc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029631 May 11 09:56:09.824328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 279/557] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:10.637385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:10.638136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:10.644549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:10.644996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:10.645762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:10.646195 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:10.777538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:10.781003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:10.781970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:10.789479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:10.789945 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:10.791070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:10.791499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:10.792894 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3a0a56ca-4163-4439-9ffc-47a38550d736 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1360 microversion: 2.1 time: 0.159344 May 11 09:56:10.793454 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 279/558] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:10 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:10.865994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '332b151b87ec412195fab910140cd163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac5dee78b854e3cbe6a7d8dbba88554', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:10.873334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b6b6f27a-bc2b-426d-bd64-2667ed736af6 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 200 len: 1479 microversion: 2.1 time: 0.101106 May 11 09:56:10.873898 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 280/559] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:10 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 1479 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:56:10.942733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-4110519d-8ef0-43f4-8121-368a69fa2361 req-4bbe1e13-7c19-4463-9d6e-1a2cb2f2f5ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e", "name": "network-vif-deleted", "tag": "cb7c958a-6b81-40de-807f-f4b25b2a1457"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:10.950613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4110519d-8ef0-43f4-8121-368a69fa2361 req-4bbe1e13-7c19-4463-9d6e-1a2cb2f2f5ea service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:10.951044 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-4110519d-8ef0-43f4-8121-368a69fa2361 req-4bbe1e13-7c19-4463-9d6e-1a2cb2f2f5ea service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:10.963420 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-4110519d-8ef0-43f4-8121-368a69fa2361 req-4bbe1e13-7c19-4463-9d6e-1a2cb2f2f5ea service nova] Creating event network-vif-deleted:cb7c958a-6b81-40de-807f-f4b25b2a1457 for instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e on hv-cinder-83699 May 11 09:56:10.968382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-4110519d-8ef0-43f4-8121-368a69fa2361 req-4bbe1e13-7c19-4463-9d6e-1a2cb2f2f5ea service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029293 May 11 09:56:10.968969 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 280/560] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:11.810457 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:11.811087 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:11.818126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:11.818573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:11.819358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:11.820119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:11.891740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:11.893168 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] [instance: 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:11.899498 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:11.900300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:11.901143 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:11.901788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:11.915342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] HTTP exception thrown: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Request method failure captured: May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e HTTP/1.1 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpVnFwjHwqwuobvyTiROm4k6LTpNK2ruFLnzVXHbHlU_TJpO7NlHLdT8nAoMQY5ZkcOZ0cUkBFL6H4NwAwWsvYcP3Q49AsXYZfuEPR4F3wuO9kvaqdZYL3daukv5VXh9diTFKRse-nuMXcJld28WgwhoRDPkZjXj17xm-CNUyjUYE May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:56:11.918253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8ac5dee78b854e3cbe6a7d8dbba88554", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8ac5dee78b854e3cbe6a7d8dbba88554"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 8ac5dee78b854e3cbe6a7d8dbba88554 May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-948757819 May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 332b151b87ec412195fab910140cd163 May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-ServerRescueNegativeTestJSON-948757819-project May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. May 11 09:56:11.919809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e'} May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:56:11.920618 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. May 11 09:56:11.921758 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:56:11.923989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] Returning 404 to user: Instance 1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:56:11.925052 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7927c89b-db6b-4339-8c0c-82c39566c5f1 tempest-ServerRescueNegativeTestJSON-948757819 tempest-ServerRescueNegativeTestJSON-948757819-project] 10.222.0.44 "GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e" status: 404 len: 111 microversion: 2.1 time: 0.038641 May 11 09:56:11.926130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 281/561] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:11 2022] GET /compute/v2.1/servers/1222df6e-2a9c-4aa2-bc20-f9ce3043bc0e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 09:56:11.971257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:11.980238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1a388ada-0d4f-4fc4-9601-1bc572e27b0c tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1545 microversion: 2.1 time: 0.173790 May 11 09:56:11.981258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 281/562] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:11 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1545 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:11.997804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:11.998294 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:12.004410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:12.005425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:12.006377 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:12.006809 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:12.123354 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6da81ff2-5103-48ad-b649-ac59a913dc6d tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129367 May 11 09:56:12.123980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 282/563] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:56:11 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:56:13.087999 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-c5dac8ad-8ac8-43a3-8cd8-755df88cb23b req-b15bca72-02a3-4875-952d-3f0385a5a14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcbbf608-e664-442c-8b03-e59f4ecd492e", "tag": "4101ae28-9733-441a-b102-4ff98e2e80e7"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:13.097297 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c5dac8ad-8ac8-43a3-8cd8-755df88cb23b req-b15bca72-02a3-4875-952d-3f0385a5a14f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:13.097742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c5dac8ad-8ac8-43a3-8cd8-755df88cb23b req-b15bca72-02a3-4875-952d-3f0385a5a14f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:13.110819 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-c5dac8ad-8ac8-43a3-8cd8-755df88cb23b req-b15bca72-02a3-4875-952d-3f0385a5a14f service nova] Creating event network-changed:4101ae28-9733-441a-b102-4ff98e2e80e7 for instance fcbbf608-e664-442c-8b03-e59f4ecd492e on hv-cinder-83699 May 11 09:56:13.116424 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-c5dac8ad-8ac8-43a3-8cd8-755df88cb23b req-b15bca72-02a3-4875-952d-3f0385a5a14f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032136 May 11 09:56:13.117479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 282/564] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:15.485419 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:15.485905 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:15.493044 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:15.493497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:15.494265 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:15.494796 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:15.520449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-50b585cc-c9f6-4ca4-8dd4-2f33dec10800 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/ips" status: 200 len: 151 microversion: 2.20 time: 0.038738 May 11 09:56:15.521942 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 283/565] 10.222.0.44 () {60 vars in 1288 bytes} [Wed May 11 09:56:15 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 11 09:56:17.443322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:17.444063 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:17.450591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:17.451041 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:17.452046 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:17.452477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:17.475677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lazy-loading 'flavor' on Instance uuid 5b6cc551-b8d0-464d-95c5-0f9400c489e6 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:56:17.739313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-17b38408-f4c1-4818-884b-b187ebb97743 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/action" status: 202 len: 0 microversion: 2.20 time: 0.300761 May 11 09:56:17.743173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 283/566] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 09:56:17 2022] POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:56:17.749762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:17.751446 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:17.759636 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:17.760512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:17.761742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:17.762632 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:17.907309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:17.916701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:17.918278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:17.919500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-661c346e-7909-46a4-8894-39c66f35fa7f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.175117 May 11 09:56:17.931504 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 284/567] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:17 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:18.941159 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:18.943295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:18.952862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:18.953982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:18.955610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:18.956286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:19.412194 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:19.426902 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:19.429530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:19.430824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-17c781ac-1d53-4d2e-83b8-f8f5477597f2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.495210 May 11 09:56:19.431683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 284/568] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:18 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:20.450080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:20.450731 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:20.459344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:20.459825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:20.460605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:20.461037 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:20.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:20.763165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:20.765071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:20.766448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-78f5a178-7389-48dc-ae96-387dbf129772 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.320453 May 11 09:56:20.767521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 285/569] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:20 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:21.041435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1a4dc341-b7f5-45b8-bf39-4734b217a269 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: .version_select at 0x7f8bcd43f310>, body: {"keypair": {"name": "tempest-keypair-1321108736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPLB2/fm4ayzSjQIwAhT//eAe/Wf9N6ykiD8PVhaiO1tRv024DJtrRVHLIyAv6Ew5byeiE3k6Ma2i2ziBveItEbmU/9z2miU6ysH2HlLKyphFscxPbo9Xoq4KCOsZ+g/BA=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:21.054737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-1a4dc341-b7f5-45b8-bf39-4734b217a269 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:56:21.058421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-1a4dc341-b7f5-45b8-bf39-4734b217a269 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:56:21.079599 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1a4dc341-b7f5-45b8-bf39-4734b217a269 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093033 May 11 09:56:21.080211 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 285/570] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:56:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:21.784728 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:21.785878 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:21.793517 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:21.794180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:21.795345 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:21.795806 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:22.027001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:22.036704 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:22.039345 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:22.041175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6ef69d95-c0e1-4324-abf1-c23354cbcc48 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.260513 May 11 09:56:22.053359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 286/571] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:21 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:22.421183 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1250103501", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c5000ec-9218-43b8-af63-690179d5f88f"}], "security_groups": [{"name": "tempest-securitygroup--1829299622"}], "key_name": "tempest-keypair-1321108736", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:22.650643 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] validate_networks() for [('2c5000ec-9218-43b8-af63-690179d5f88f', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:56:23.044953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:56:23.045379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:56:23.045858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:56:23.046269 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:56:23.046680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:56:23.057890 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:23.058346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:23.059144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:23.059478 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:23.059962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:23.060888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:23.068830 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:23.069291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:23.070668 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:23.071131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:23.077097 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:56:23.081163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:56:23.093491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:56:23.095783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:56:23.146356 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b0ae3eb1-4882-469e-9fda-b3e4cfc9bd56 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729969 May 11 09:56:23.152069 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 286/572] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:56:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:56:23.158329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0738a574-1fac-4ec9-adf0-c5dcdabe768e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:23.160622 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0738a574-1fac-4ec9-adf0-c5dcdabe768e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:23.242839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0738a574-1fac-4ec9-adf0-c5dcdabe768e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:23.246642 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:23.249446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0738a574-1fac-4ec9-adf0-c5dcdabe768e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1242 microversion: 2.1 time: 0.096191 May 11 09:56:23.250759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 287/573] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:23 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1242 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:23.260916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:23.262574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:23.264304 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-90972b89-3c6a-4188-9148-743e2764b53a tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.208135 May 11 09:56:23.265065 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 287/574] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:23 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:24.267503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:24.268285 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:24.281016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:24.281882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:24.283679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:24.283813 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:24.284448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:24.285095 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:24.297486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:24.297944 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:24.298737 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:24.299175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:24.386903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:24.394855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b02d3a5-fa07-41d8-b0d7-41da2e500fbd tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1302 microversion: 2.1 time: 0.132104 May 11 09:56:24.395971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 288/575] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:24 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:24.458735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:24.469653 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:24.471931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:24.473319 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d9b2a207-485b-4ade-81e0-d37ac72f36c4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.194049 May 11 09:56:24.474855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 288/576] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:24 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:25.414377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:25.416143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:25.421803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:25.422262 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:25.423070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:25.423729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:25.491002 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:25.491548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:25.497991 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:25.498449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:25.499218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:25.499654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:25.624930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:25.631042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:25.633665 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0a090c75-e8cf-4044-b1b6-8b6b9410e3c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.223990 May 11 09:56:25.634359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 289/577] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:25 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:25.639726 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:25.641235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:25.642395 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d3592878-c047-428b-aa74-196d876ff33b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.155446 May 11 09:56:25.642984 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 289/578] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:25 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:26.233915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-11c7a1a3-ddde-4354-a6b3-629792a1c5ee req-50dfb96b-0600-4189-9447-cf48ddf736db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3a8d92-c02e-49c8-b910-892dfca23b1f", "tag": "b07f9725-379d-4fd2-bd3c-580a32596a84"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:26.246991 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-11c7a1a3-ddde-4354-a6b3-629792a1c5ee req-50dfb96b-0600-4189-9447-cf48ddf736db service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:26.247683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-11c7a1a3-ddde-4354-a6b3-629792a1c5ee req-50dfb96b-0600-4189-9447-cf48ddf736db service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:26.268020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-11c7a1a3-ddde-4354-a6b3-629792a1c5ee req-50dfb96b-0600-4189-9447-cf48ddf736db service nova] Creating event network-changed:b07f9725-379d-4fd2-bd3c-580a32596a84 for instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f on hv-cinder-83699 May 11 09:56:26.273562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-11c7a1a3-ddde-4354-a6b3-629792a1c5ee req-50dfb96b-0600-4189-9447-cf48ddf736db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043388 May 11 09:56:26.274163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 290/579] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:26.650833 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:26.651405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:26.658516 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:26.658977 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:26.659782 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:26.660224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:26.661902 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:26.663277 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:26.669694 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:26.670139 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:26.670911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:26.671340 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:26.788252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:26.795629 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d010959d-ea23-4187-978a-e45023d817da tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.149204 May 11 09:56:26.796223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 290/580] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:26 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:26.801391 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:26.810344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:26.812121 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:26.813324 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b184f025-554e-4ced-ab6a-98a2e9fa3084 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.156288 May 11 09:56:26.813828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 291/581] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:26 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:27.813035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:27.813673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:27.819931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:27.820367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:27.821122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:27.821549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:27.832314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:27.833114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:27.839414 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:27.839964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:27.840794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:27.841451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:27.955963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:27.963099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-454e2f34-d003-4a95-82e1-5d6c7fc6b4c8 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.154256 May 11 09:56:27.963667 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 291/582] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:27 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:27.969931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:27.978094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:27.979590 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:27.980753 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e16360eb-6496-48f1-ab9e-628d77d12a5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.152251 May 11 09:56:27.981294 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 292/583] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:27 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:28.979440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:28.980075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:28.986460 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:28.986898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:28.987658 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:28.988122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:28.998368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:28.998970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:29.005344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:29.005778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:29.007197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:29.007659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:29.114373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:29.122125 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ada24920-e949-465a-89ca-3e14276a17d5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.146545 May 11 09:56:29.122689 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 292/584] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:28 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:29.138548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:29.146133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:29.148461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:29.149603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2a8b35e6-05af-4036-a4b6-dbe76ddc1696 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.155066 May 11 09:56:29.150156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 293/585] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:28 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:30.138500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:30.139118 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:30.145490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:30.145945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:30.146720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:30.147820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:30.167815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:30.168614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:30.175570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:30.176187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:30.177060 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:30.177758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:30.295581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:30.303034 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e2838ea9-90a6-4746-99c0-ab8cc6c62e8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.168356 May 11 09:56:30.303983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 293/586] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:30 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:30.320439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:30.328128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:30.329635 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:30.330783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8b5683ba-ec8f-44af-954b-a09b482742a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.167180 May 11 09:56:30.331333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 294/587] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:30 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:31.319742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:31.320347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:31.326620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:31.327061 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:31.327837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:31.328263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:31.349224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:31.349830 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:31.356386 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:31.356833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:31.357596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:31.358035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:31.462605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:31.469954 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c4140577-9169-4eb7-aa47-13ded26a7bf0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.154079 May 11 09:56:31.470453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 294/588] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:31 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:31.491209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:31.498964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:31.500503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:31.501671 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fdb125ba-8786-4944-b247-2fe076ecd6ac tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.156245 May 11 09:56:31.502213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 295/589] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:31 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:31.899383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-b0c55880-053c-46dc-8995-12f1825e5d1c req-3026f8bf-2950-45a7-be71-01a436758a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3a8d92-c02e-49c8-b910-892dfca23b1f", "name": "network-vif-plugged", "status": "completed", "tag": "b07f9725-379d-4fd2-bd3c-580a32596a84"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:31.907333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b0c55880-053c-46dc-8995-12f1825e5d1c req-3026f8bf-2950-45a7-be71-01a436758a73 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:31.907852 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b0c55880-053c-46dc-8995-12f1825e5d1c req-3026f8bf-2950-45a7-be71-01a436758a73 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:31.920832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-b0c55880-053c-46dc-8995-12f1825e5d1c req-3026f8bf-2950-45a7-be71-01a436758a73 service nova] Creating event network-vif-plugged:b07f9725-379d-4fd2-bd3c-580a32596a84 for instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f on hv-cinder-83699 May 11 09:56:31.925790 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-b0c55880-053c-46dc-8995-12f1825e5d1c req-3026f8bf-2950-45a7-be71-01a436758a73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 May 11 09:56:31.926453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 295/590] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:32.487279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:32.487934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:32.494346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:32.494791 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:32.495571 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:32.496016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:32.621028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:32.621515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:32.621725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:32.627948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:32.628426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:32.628814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5f8e12c1-04fe-4672-a88c-a15f49246715 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1368 microversion: 2.1 time: 0.145074 May 11 09:56:32.629539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 296/591] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:32 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:32.634321 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:32.634832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:32.760693 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:32.768346 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:32.769844 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:32.770993 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-94d58626-e268-4b3d-b05b-009c21486400 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.254533 May 11 09:56:32.771545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 296/592] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:32 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:33.649626 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:33.650250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:33.659729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.660177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.660950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.661383 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.789463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:33.789989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:33.796640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.797086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.797927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.798274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.801881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:33.811837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-be3be11f-f633-449b-93fd-22af8326c48c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1559 microversion: 2.1 time: 0.169117 May 11 09:56:33.812407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 297/593] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:56:33 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:56:33.828410 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:33.828907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:33.835566 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.836038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.836835 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:33.837265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:33.914949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6177f45b-4b5b-44e4-bd94-eee79080c02a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090225 May 11 09:56:33.915547 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 298/594] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:56:33 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:56:33.935126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:33.942836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:33.944915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:33.946078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ef8ae511-8551-4117-9871-94ae03735ef8 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1742 microversion: 2.20 time: 0.161048 May 11 09:56:33.946880 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 297/595] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:33 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:34.859733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-84486738-b635-44d3-b270-865932d33882 req-7704fad6-d778-484a-adaa-ca7ed1e0b919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c3a8d92-c02e-49c8-b910-892dfca23b1f", "tag": "b07f9725-379d-4fd2-bd3c-580a32596a84"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:34.868127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-84486738-b635-44d3-b270-865932d33882 req-7704fad6-d778-484a-adaa-ca7ed1e0b919 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:34.868565 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-84486738-b635-44d3-b270-865932d33882 req-7704fad6-d778-484a-adaa-ca7ed1e0b919 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:34.879220 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-84486738-b635-44d3-b270-865932d33882 req-7704fad6-d778-484a-adaa-ca7ed1e0b919 service nova] Creating event network-changed:b07f9725-379d-4fd2-bd3c-580a32596a84 for instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f on hv-cinder-83699 May 11 09:56:34.884284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-84486738-b635-44d3-b270-865932d33882 req-7704fad6-d778-484a-adaa-ca7ed1e0b919 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028459 May 11 09:56:34.884968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 299/596] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:34.965339 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:34.965951 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:34.972395 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:34.972845 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:34.973614 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:34.974047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:35.105885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:35.114000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:35.115602 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:35.116808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8fa1f4cc-65a8-4867-9b9d-911529085462 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1742 microversion: 2.20 time: 0.155406 May 11 09:56:35.117563 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 298/597] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:34 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:36.136185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:36.136887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:36.143413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:36.143911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:36.144696 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:36.145131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:36.299982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:36.308267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:36.310238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:36.311593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-33da8ef4-c517-440c-8138-53724d364d54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.180628 May 11 09:56:36.323299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 300/598] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:36 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:37.330328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:37.330938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:37.337871 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:37.338341 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:37.339129 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:37.339568 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:37.483392 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:37.492186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:37.493678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:37.495204 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-83652af4-f016-4cbf-bf59-84b34f1506a5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.168611 May 11 09:56:37.496113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 299/599] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:37 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:37.964266 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-d253992d-fbe3-45de-bc96-189e9d6702f3 req-37035698-125a-4e99-a4e6-aa349731aecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:37.978653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-d253992d-fbe3-45de-bc96-189e9d6702f3 req-37035698-125a-4e99-a4e6-aa349731aecf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:37.979102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-d253992d-fbe3-45de-bc96-189e9d6702f3 req-37035698-125a-4e99-a4e6-aa349731aecf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:37.992473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-d253992d-fbe3-45de-bc96-189e9d6702f3 req-37035698-125a-4e99-a4e6-aa349731aecf service nova] Creating event network-vif-plugged:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:56:37.997551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-d253992d-fbe3-45de-bc96-189e9d6702f3 req-37035698-125a-4e99-a4e6-aa349731aecf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038077 May 11 09:56:37.998149 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 301/600] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:38.514005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:38.514611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:38.523022 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:38.523881 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:38.524839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:38.525279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:38.668198 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:38.676744 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:38.679069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:38.680286 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b3cb1cb2-f408-42d3-aa0a-6eeb4cbdfdb4 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.170241 May 11 09:56:38.689060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 300/601] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:38 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:39.699725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:39.700416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:39.707385 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:39.708358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:39.709204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:39.709765 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:39.853493 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:39.865514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:39.867071 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:39.868302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d280b433-0842-4c16-ba86-570559f5c12e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.173486 May 11 09:56:39.869072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 302/602] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:39 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:40.888836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:40.890191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:40.897651 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:40.898103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:40.898906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:40.899331 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:41.050967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:41.059682 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:41.061237 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:41.062833 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-eb050149-664b-4eab-8232-e9824a4a8970 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.179710 May 11 09:56:41.074403 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 301/603] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:40 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:42.082206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:42.084585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:42.092394 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:42.093129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:42.094167 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:42.094793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:42.252842 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:42.266424 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:42.267956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:42.269121 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c80d3377-b991-4514-9ee6-5a7b7572628f tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.191129 May 11 09:56:42.270015 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 303/604] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:42 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:43.286316 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:43.287019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:43.294126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:43.294569 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:43.295336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:43.295788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:43.434376 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:43.444278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:43.446279 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:43.447503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6fc0f011-2aa4-4eab-9ed5-5b20e29053a7 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.165086 May 11 09:56:43.459175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 302/605] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:43 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:44.465506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:44.466117 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:44.476906 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:44.477265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:44.478079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:44.478532 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:44.628734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:44.637499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:44.639142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:44.640856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-26864784-92b1-4744-a7a9-5fa967c21e32 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1737 microversion: 2.20 time: 0.179087 May 11 09:56:44.642634 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 304/606] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:44 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:45.659775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:45.660389 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:45.666909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:45.667357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:45.668149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:45.668587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:45.795810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:45.805509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:45.807404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:45.808770 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cbf91671-6657-428c-9a21-8d4a2a72944b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1719 microversion: 2.20 time: 0.152888 May 11 09:56:45.809373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 303/607] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:45 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:46.827133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:46.827750 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:46.834534 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:46.834976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:46.835754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:46.836184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:46.960039 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:46.967646 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:46.969159 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:46.970291 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f9e30aa7-6c61-4c21-a5a6-911f760d5b43 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1719 microversion: 2.20 time: 0.147020 May 11 09:56:46.970845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 305/608] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:46 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1719 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:47.988423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:47.989059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:47.995435 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:47.995890 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:47.996659 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:47.997093 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.129978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:48.137778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:48.139283 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:48.140468 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d786c8a6-2eb8-460d-86fa-385d39b4c20b tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1722 microversion: 2.20 time: 0.155982 May 11 09:56:48.141032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 304/609] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:47 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:48.158612 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef803556-c91f-44bf-a519-602d2ed51f68"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:48.159803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:48.166276 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.166717 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.167472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.167927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.436951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-51bbd420-37d0-453b-aaed-07e068f4b69d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282298 May 11 09:56:48.437547 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 306/610] 10.222.0.44 () {62 vars in 1363 bytes} [Wed May 11 09:56:48 2022] POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 11 09:56:48.546135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:48.546646 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:48.553051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.553495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.554247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.554674 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.759078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a1a4be4e-5cb7-43ee-91bf-4acba03397b2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments/ef803556-c91f-44bf-a519-602d2ed51f68" status: 202 len: 0 microversion: 2.20 time: 0.216929 May 11 09:56:48.759658 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 305/611] 10.222.0.44 () {60 vars in 1456 bytes} [Wed May 11 09:56:48 2022] DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments/ef803556-c91f-44bf-a519-602d2ed51f68 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:56:48.817896 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:48.818471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:48.825125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.825572 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.826333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.826766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.899558 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-172c5907-7100-4c41-9dc3-305f1e024eb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/action" status: 202 len: 0 microversion: 2.20 time: 0.085695 May 11 09:56:48.900348 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 307/612] 10.222.0.44 () {62 vars in 1318 bytes} [Wed May 11 09:56:48 2022] POST /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 11 09:56:48.908316 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:48.908921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:48.915380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.915859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:48.916621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:48.917049 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:49.074331 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:49.082216 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:49.083867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:49.085027 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3ad306a7-ff8a-44be-ae22-7378cf489741 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1670 microversion: 2.20 time: 0.180587 May 11 09:56:49.085574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 306/613] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:48 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1670 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:49.387041 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:49.387555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:49.393759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:49.394740 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:49.395700 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:49.396151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:49.422569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2479ea41-51ff-4493-9a71-b5833b5526d9 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/ips" status: 200 len: 144 microversion: 2.1 time: 0.137537 May 11 09:56:49.423479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 308/614] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:56:49 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/ips => generated 144 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:49.998684 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-274367f3-3731-4a97-af7b-58aa7e3abbee req-f394d328-fd6d-41d3-b4d0-31844fe4b482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "name": "network-vif-unplugged", "status": "completed", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:50.009467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-274367f3-3731-4a97-af7b-58aa7e3abbee req-f394d328-fd6d-41d3-b4d0-31844fe4b482 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:50.010265 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-274367f3-3731-4a97-af7b-58aa7e3abbee req-f394d328-fd6d-41d3-b4d0-31844fe4b482 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:50.022150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-274367f3-3731-4a97-af7b-58aa7e3abbee req-f394d328-fd6d-41d3-b4d0-31844fe4b482 service nova] Creating event network-vif-unplugged:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:56:50.027604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-274367f3-3731-4a97-af7b-58aa7e3abbee req-f394d328-fd6d-41d3-b4d0-31844fe4b482 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032952 May 11 09:56:50.028667 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 307/615] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:56:50.102342 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:50.102974 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:50.108795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:50.109249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:50.110018 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:50.110454 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:50.297651 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:50.305698 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:50.307197 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:50.308382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2c20f7e7-9fe6-4c94-a1d7-ee6a8c23b6dd tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.209965 May 11 09:56:50.308940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 309/616] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:50 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:56:50.734919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ef6ba6d-c100-4f4f-9033-358a75ac3495"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:56:50.736105 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:50.743003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:50.743530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:50.744408 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:50.744906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:51.326413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:51.327012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:51.333517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:51.333965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:51.334733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:51.335168 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:51.498858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:51.508382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:51.510202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:51.511452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-88f7e615-3787-49a1-8eab-fe949e0818a3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.188905 May 11 09:56:51.512102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 310/617] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:51 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:52.530125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:52.530838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:52.537138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:52.537596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:52.538386 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:52.539110 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:52.692319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:52.700238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:52.701742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:52.702872 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2fc2b92e-5b2f-4322-9269-e476ee6adca1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.176778 May 11 09:56:52.703422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 311/618] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:52 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:53.723841 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:53.724682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:53.731530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:53.732051 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:53.732870 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:53.733271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:53.870707 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:53.880987 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:53.882546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:53.883681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9bf1e26a-9563-4ca2-acfe-7dbeff49c708 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.164714 May 11 09:56:53.894845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 312/619] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:53 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:54.902289 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:54.902953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:54.909536 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:54.909978 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:54.910734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:54.911165 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:55.051154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:55.059195 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:55.060729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:55.061873 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ba5368ca-ebd6-4201-8441-3434a4af9d5d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.163474 May 11 09:56:55.062430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 313/620] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:54 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:56.080433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:56.081057 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:56.087440 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:56.087930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:56.088701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:56.089136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:56.254966 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:56.262763 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:56.264312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:56.265467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-47e2912b-10de-4c74-86fd-4c8e4611e9ec tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.188995 May 11 09:56:56.266027 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 314/621] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:56 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:57.283786 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:57.284434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:57.291446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:57.291926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:57.292694 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:57.293126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:57.446224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:57.454470 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:57.455987 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:57.457812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-53b22c38-5b13-4243-a8e4-e188c02d637c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.177346 May 11 09:56:57.458582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 315/622] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:57 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:58.476569 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:58.477256 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:58.483334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:58.483822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:58.484614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:58.485045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:58.648400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:58.656178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:58.657669 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:58.658808 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b17a02ec-85f3-4644-96d6-b47482a5c9f1 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.186830 May 11 09:56:58.659557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 316/623] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:58 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:56:59.677826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:56:59.679849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:56:59.687214 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:59.688115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:59.688976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:56:59.689484 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:56:59.843982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:59.852562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:59.854095 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:56:59.855243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90b202f1-4f24-48b9-b6a9-c386f5e1c1bc tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.182127 May 11 09:56:59.855816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 317/624] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:56:59 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:57:00.873387 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:00.874065 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:00.879936 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:00.880377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:00.881129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:00.881557 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:01.009849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:01.017594 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:01.019126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:01.020297 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a7fee890-0a4c-4d6e-89ef-199aefcd9a08 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.150934 May 11 09:57:01.020939 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 318/625] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:00 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:57:02.038515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:02.039202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:02.045382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:02.045828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:02.046592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:02.047025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:02.171421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:02.179774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:02.181281 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:02.182422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-226388c6-775a-4740-bf73-f1be4d8e178d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.148056 May 11 09:57:02.182982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 319/626] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:02 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:57:03.200609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:03.201275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:03.208499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:03.208948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:03.209747 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:03.210175 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:03.349885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4de5e9e9-6ad5-4b37-a114-5922bb6fe0b7 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.619055 May 11 09:57:03.354983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 308/627] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:56:50 2022] POST /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 194 bytes in 12621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:03.366751 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:03.374806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:03.376536 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:03.377686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8e6f1f7d-ea6b-449a-b372-f411310599be tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.181028 May 11 09:57:03.378310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 320/628] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:03 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:57:04.396965 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:04.397686 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:04.403821 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:04.404266 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:04.405027 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:04.405457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:04.539178 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:04.548918 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:04.551046 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:04.552231 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-563a1e1a-7ce2-48c1-90bb-701199fafc9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1728 microversion: 2.20 time: 0.159985 May 11 09:57:04.553263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 309/629] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:04 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:57:05.573067 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:05.573670 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:05.580008 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:05.580452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:05.581860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:05.582292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:05.708733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:05.716374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:05.717885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:05.719030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9436365f-757d-43dc-80d9-075debbee3e2 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1715 microversion: 2.20 time: 0.149863 May 11 09:57:05.719579 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 321/630] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:05 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1715 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:57:08.174521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-8ee58aa9-9475-4a95-b553-638636f7328b req-6251582f-6a8d-4f23-add9-9ff658360ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:08.183171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-8ee58aa9-9475-4a95-b553-638636f7328b req-6251582f-6a8d-4f23-add9-9ff658360ad6 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:08.183610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-8ee58aa9-9475-4a95-b553-638636f7328b req-6251582f-6a8d-4f23-add9-9ff658360ad6 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:08.194282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-8ee58aa9-9475-4a95-b553-638636f7328b req-6251582f-6a8d-4f23-add9-9ff658360ad6 service nova] Creating event network-vif-plugged:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:57:08.199431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-8ee58aa9-9475-4a95-b553-638636f7328b req-6251582f-6a8d-4f23-add9-9ff658360ad6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084870 May 11 09:57:08.200027 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 310/631] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:09.775171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:09.776217 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:09.782592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:09.783039 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:09.784345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:09.784784 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:09.814293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b55e57a0-63c8-4744-a8ad-70ff34db4cd5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 May 11 09:57:09.814769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 322/632] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:57:09 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:09.824999 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:09.825580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:09.832467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:09.832917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:09.833687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:09.834124 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:09.862461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-50034739-e3c9-4cd2-9471-188fdb63b092 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495" status: 200 len: 194 microversion: 2.1 time: 0.041066 May 11 09:57:09.863088 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 311/633] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 09:57:09 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:11.163126 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57eb48a4-458b-4cb6-a6f0-a5dac2e3c144"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:11.164222 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:11.170476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:11.170930 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:11.171716 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:11.172176 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:11.405798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-40f4d94f-8273-48eb-8566-e44a7a672490 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "POST /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246694 May 11 09:57:11.406421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 323/634] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:57:11 2022] POST /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 194 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:18.871553 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:18.872500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:18.879270 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:18.879728 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:18.880483 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:18.880908 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:18.909312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-857fff70-6237-49bc-a5b9-5eab7849c779 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041704 May 11 09:57:18.909839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 312/635] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:57:18 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:19.056288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:19.056813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:19.062917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.063366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.064652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.065085 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.092672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3055bb09-1321-46b7-96e1-cd86dd785536 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495" status: 200 len: 194 microversion: 2.1 time: 0.041323 May 11 09:57:19.093231 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 324/636] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 09:57:19 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:19.102599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:19.103091 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:19.108906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.109352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.110109 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.111055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.186762 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lazy-loading 'services' on Instance uuid fcbbf608-e664-442c-8b03-e59f4ecd492e {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:57:19.255319 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-06e943e2-99b4-45ab-b592-def49abf65a6 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495" status: 202 len: 0 microversion: 2.1 time: 0.156429 May 11 09:57:19.255939 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 313/637] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:57:19 2022] DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/0ef6ba6d-c100-4f4f-9033-358a75ac3495 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:57:19.454204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:19.454621 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:19.460876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.461322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.462082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:19.462517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:19.484727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf37af8a-c40b-41ea-9484-bf0ef729b60d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/ips" status: 200 len: 151 microversion: 2.1 time: 0.034428 May 11 09:57:19.485272 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 325/638] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:57:19 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:20.363237 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:20.363856 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:20.369932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.370385 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:20.371150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.371587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:20.400048 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dbc501de-f6ea-4b74-b0fd-b1330ec1c3da tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/57eb48a4-458b-4cb6-a6f0-a5dac2e3c144" status: 200 len: 194 microversion: 2.1 time: 0.041530 May 11 09:57:20.400630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 314/639] 10.222.0.44 () {58 vars in 1412 bytes} [Wed May 11 09:57:20 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/57eb48a4-458b-4cb6-a6f0-a5dac2e3c144 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:20.410313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:20.411130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:20.417725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.418167 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:20.418922 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.419352 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:20.496038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lazy-loading 'services' on Instance uuid fcbbf608-e664-442c-8b03-e59f4ecd492e {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:57:20.566487 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c2c9f935-cdfa-4ed9-8b91-d9582bd8ca5b tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/57eb48a4-458b-4cb6-a6f0-a5dac2e3c144" status: 202 len: 0 microversion: 2.1 time: 0.160008 May 11 09:57:20.567070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 326/640] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:57:20 2022] DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments/57eb48a4-458b-4cb6-a6f0-a5dac2e3c144 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:57:20.818501 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a29685f-e37a-4b0f-bc9d-ca58447ca6e6"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:20.819498 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:20.825358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.825805 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:20.826568 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:20.827004 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.061857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7efc1558-c7b7-4980-8b25-a540f0e55df7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247722 May 11 09:57:21.062666 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 315/641] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:57:20 2022] POST /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:21.722043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:21.723101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:21.729163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.729615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.730378 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.730818 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.758494 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-82f89d68-3ec2-4bdd-a6ad-c66f5209487f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041806 May 11 09:57:21.759030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 327/642] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:57:21 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:57:21.861123 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:21.862218 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:21.868387 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.868835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.869596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.870028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.899204 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8dd4a6e4-2f05-434c-80fa-ae6a8e5b47c5 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042815 May 11 09:57:21.899791 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 316/643] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:57:21 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:57:21.954527 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:21.955024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:21.960830 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.961279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.962094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:21.962526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:21.986135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:57:22.056967 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-16388691-1534-435b-931e-2f8359d7ebbe tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 204 len: 0 microversion: 2.1 time: 0.106445 May 11 09:57:22.057525 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 328/644] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:57:21 2022] DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:57:22.066140 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:22.066750 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:22.073063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:22.073507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:22.074268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:22.074701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:22.201119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:22.208752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-40033f5f-6ce8-43d9-ab47-225be20d2069 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1669 microversion: 2.1 time: 0.146873 May 11 09:57:22.209343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 317/645] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:22 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1669 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:23.227012 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:23.227737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:23.233995 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:23.234445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:23.235262 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:23.235714 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:23.626780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:23.634866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9cf7fdeb-45cf-4711-9349-926819e291f8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1669 microversion: 2.1 time: 0.412064 May 11 09:57:23.635434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 329/646] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:23 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1669 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:24.652201 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:24.652823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:24.659822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:24.660537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:24.661315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:24.661752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:24.756114 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a535775680c46b7bd5b8348ee0a3a25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd559012f039049b98f84658174e6f125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:24.756299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-aea6f474-2163-40d5-adaf-e89c37a04bd6 req-965bc6c7-9541-40e7-b3d1-cca9eb4d469a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcbbf608-e664-442c-8b03-e59f4ecd492e", "name": "network-vif-deleted", "tag": "4101ae28-9733-441a-b102-4ff98e2e80e7"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:24.765212 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2d327330-a7f6-4c43-9b57-3450224ac1b0 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 200 len: 1603 microversion: 2.1 time: 0.117139 May 11 09:57:24.766760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aea6f474-2163-40d5-adaf-e89c37a04bd6 req-965bc6c7-9541-40e7-b3d1-cca9eb4d469a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:24.769122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 318/647] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:24 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 1603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:24.780206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aea6f474-2163-40d5-adaf-e89c37a04bd6 req-965bc6c7-9541-40e7-b3d1-cca9eb4d469a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:24.796887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-aea6f474-2163-40d5-adaf-e89c37a04bd6 req-965bc6c7-9541-40e7-b3d1-cca9eb4d469a service nova] Creating event network-vif-deleted:4101ae28-9733-441a-b102-4ff98e2e80e7 for instance fcbbf608-e664-442c-8b03-e59f4ecd492e on hv-cinder-83699 May 11 09:57:24.802355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-aea6f474-2163-40d5-adaf-e89c37a04bd6 req-965bc6c7-9541-40e7-b3d1-cca9eb4d469a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112634 May 11 09:57:24.803321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 330/648] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:57:25.785928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:25.786623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:25.793630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:25.794057 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:25.794932 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:25.795288 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:25.808954 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e HTTP/1.1 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:25.810587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:25.812160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'fcbbf608-e664-442c-8b03-e59f4ecd492e'} May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:25.813590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:25.815028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:25.816353 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:25.816353 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f6ab5d6f-b94c-42f3-a1c8-41606b643a68 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 404 len: 111 microversion: 2.1 time: 0.030525 May 11 09:57:25.816353 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 319/649] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:25 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:57:25.822193 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3f792604-1c16-4053-b149-7b0c2de145ec tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '.version_select at 0x7f8bcd3d0e50>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:25.839790 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3f792604-1c16-4053-b149-7b0c2de145ec tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422797405" status: 202 len: 0 microversion: 2.1 time: 0.022030 May 11 09:57:25.840361 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 331/650] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 09:57:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422797405 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:57:28.541077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1f09023f-0f30-405d-bb6d-7e53a5f781c6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: .version_select at 0x7f8bcd497820>, body: {"keypair": {"name": "tempest-keypair-1550609919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPk1yOEd1f7K2ZfQ1U0YQwVMky4GN+s6xDEAaT+hkmQuqG13QMljKyvCk43B940WtKRDApzTefGP0lZsxfv5wqWVwXFPp0yLnYAXu5mcUqKsstu6MQl66Mg89iDMJ9hvEg=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:28.555341 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-1f09023f-0f30-405d-bb6d-7e53a5f781c6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:57:28.559014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-1f09023f-0f30-405d-bb6d-7e53a5f781c6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:57:28.580773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1f09023f-0f30-405d-bb6d-7e53a5f781c6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043447 May 11 09:57:28.581345 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 320/651] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:57:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:28.679769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:28.680968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:28.687441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:28.688478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:28.689244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:28.689672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:28.704092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e HTTP/1.1 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:57:28.705811 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.707088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'fcbbf608-e664-442c-8b03-e59f4ecd492e'} May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:28.707822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.709267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:28.711867 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:28.711867 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9dbcefaf-b086-4941-a082-0629148aef5f tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 404 len: 111 microversion: 2.1 time: 0.031926 May 11 09:57:28.711867 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 332/652] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:57:28 2022] DELETE /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:57:28.721701 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:28.723007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: fcbbf608-e664-442c-8b03-e59f4ecd492e] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:28.729897 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:28.730461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:28.731300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:28.731902 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:28.745664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e HTTP/1.1 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:28.747191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.748720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'fcbbf608-e664-442c-8b03-e59f4ecd492e'} May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:28.752980 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. May 11 09:57:28.754402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:28.755669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance fcbbf608-e664-442c-8b03-e59f4ecd492e could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:28.755669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-df3f99f0-e481-4e08-8119-b251844fdd47 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e" status: 404 len: 111 microversion: 2.1 time: 0.036416 May 11 09:57:28.755669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 321/653] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:28 2022] GET /compute/v2.1/servers/fcbbf608-e664-442c-8b03-e59f4ecd492e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:57:29.781624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1967895440", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c5000ec-9218-43b8-af63-690179d5f88f"}], "security_groups": [{"name": "tempest-securitygroup--497018227"}], "key_name": "tempest-keypair-1550609919", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:29.882209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] validate_networks() for [('2c5000ec-9218-43b8-af63-690179d5f88f', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:57:29.890522 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:29.891681 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:29.898013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:29.898464 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:29.899236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:29.899677 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:29.913623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb HTTP/1.1 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:29.915164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.916630 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '4b269761-570a-4253-866d-f35c6b8002bb'} May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:29.917421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.918641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.919849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:29.919849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-13537d9c-4551-448d-9972-3a3c3f3fb6c8 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 404 len: 111 microversion: 2.1 time: 0.029910 May 11 09:57:29.919849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 322/654] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:57:29 2022] DELETE /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:57:29.925248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:29.925892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] [instance: 4b269761-570a-4253-866d-f35c6b8002bb] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:29.931678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:29.932174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:29.932946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:29.933387 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:29.946390 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] HTTP exception thrown: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Request method failure captured: May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb HTTP/1.1 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4cpV8FE8jTiXXIq-aY_bshgkVKtz9rzLkMRSBAcxOGNMjpwl1mp8EL9H_yyghYoprnjXJhc8Y57nEfNZPY3dpE7-P4I2_LfWVHqpVFJ2h91qlIybMbDOY1bcLK1X30qnpxM0mtwhRL0WlXjqJdtgZkgnL1hOmwH1e8WMXdrgJPZPQ4 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: d559012f039049b98f84658174e6f125 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:29.947929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d559012f039049b98f84658174e6f125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d559012f039049b98f84658174e6f125", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d559012f039049b98f84658174e6f125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: d559012f039049b98f84658174e6f125 May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeTestJSON-89783320 May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: 0a535775680c46b7bd5b8348ee0a3a25 May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeTestJSON-89783320-project May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.950196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '4b269761-570a-4253-866d-f35c6b8002bb'} May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:29.950909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. May 11 09:57:29.952166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:29.953775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] Returning 404 to user: Instance 4b269761-570a-4253-866d-f35c6b8002bb could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:29.953775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9e5fb101-d5cd-4b0d-b9b6-0ecf989adac1 tempest-AttachVolumeTestJSON-89783320 tempest-AttachVolumeTestJSON-89783320-project] 10.222.0.44 "GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb" status: 404 len: 111 microversion: 2.1 time: 0.027889 May 11 09:57:29.953775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 323/655] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:29 2022] GET /compute/v2.1/servers/4b269761-570a-4253-866d-f35c6b8002bb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:57:30.571264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:57:30.571710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:57:30.572190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:57:30.572603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:57:30.573015 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:57:30.581642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:30.582092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:30.582901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:30.583338 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:30.599607 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:57:30.603716 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:57:30.615316 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:57:30.617632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:57:30.664994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-907ff19c-83e2-48a3-a0f6-34f8895edf2b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.887594 May 11 09:57:30.670530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 333/656] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:57:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:57:30.676394 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f41e7e0c-d14d-451f-a580-4a1a3e27d089 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:30.677010 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f41e7e0c-d14d-451f-a580-4a1a3e27d089 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:30.744489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f41e7e0c-d14d-451f-a580-4a1a3e27d089 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:30.751645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f41e7e0c-d14d-451f-a580-4a1a3e27d089 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1242 microversion: 2.1 time: 0.079583 May 11 09:57:30.753430 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 324/657] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:30 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:31.770786 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:31.771548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:31.778473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:31.778920 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:31.779684 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:31.780144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:31.880397 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:31.887852 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0b68ddeb-526e-4271-bce7-496a6fb7b30a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1300 microversion: 2.1 time: 0.122112 May 11 09:57:31.888412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 334/658] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:31 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:32.905078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:32.905688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:32.917899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:32.918362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:32.919645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:32.920314 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:33.235848 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:33.251306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ffeb83fb-461a-4fb8-904d-7a979cdcee06 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.350208 May 11 09:57:33.252648 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 325/659] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:32 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:33.433631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-bcff5af5-ee34-43f9-a019-2d9ebd69b656 req-b9cfe656-829a-478d-85b1-4d20f6d1023b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05dcd92-ad7c-43e1-8679-add6e52ecb44", "tag": "a81ec2e4-8750-42eb-ad17-b890d34599ab"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:33.445802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-bcff5af5-ee34-43f9-a019-2d9ebd69b656 req-b9cfe656-829a-478d-85b1-4d20f6d1023b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:33.446248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-bcff5af5-ee34-43f9-a019-2d9ebd69b656 req-b9cfe656-829a-478d-85b1-4d20f6d1023b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:33.473651 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-bcff5af5-ee34-43f9-a019-2d9ebd69b656 req-b9cfe656-829a-478d-85b1-4d20f6d1023b service nova] Creating event network-changed:a81ec2e4-8750-42eb-ad17-b890d34599ab for instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 on hv-cinder-83699 May 11 09:57:33.479187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-bcff5af5-ee34-43f9-a019-2d9ebd69b656 req-b9cfe656-829a-478d-85b1-4d20f6d1023b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049156 May 11 09:57:33.480614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 335/660] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:34.268398 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:34.269221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:34.275647 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:34.276330 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:34.277313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:34.277754 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:34.428721 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:34.437759 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e54b929f-8e53-45fb-a1cd-8cb227d209f5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.172605 May 11 09:57:34.438371 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 326/661] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:34 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:35.455819 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:35.456626 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:35.463016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:35.463471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:35.464278 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:35.464722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:35.597728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:35.605249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-238dedba-e983-4d1d-ae92-09a06bd5352d tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.154638 May 11 09:57:35.605890 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 336/662] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:35 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:36.625152 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:36.625823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:36.632162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:36.632620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:36.633396 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:36.633833 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:36.757524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:36.764702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e3fe1e7d-4ee2-4ba8-9d8c-eb34b7b333c0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.143432 May 11 09:57:36.765883 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 327/663] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:36 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:37.059377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ed6ef668-8a6d-49c9-8056-e0514467e0ee tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd42b0d0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:37.105470 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ed6ef668-8a6d-49c9-8056-e0514467e0ee tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/53cfad5a-6f0f-463c-ac25-7a8862a0081c" status: 200 len: 351 microversion: 2.1 time: 0.049852 May 11 09:57:37.106030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 337/664] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:57:37 2022] GET /compute/v2.1/os-volumes/53cfad5a-6f0f-463c-ac25-7a8862a0081c => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:37.782409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:37.783024 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:37.789620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:37.790070 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:37.790842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:37.791276 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:37.916135 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:37.923780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f87cad16-4ba3-4bb9-b926-5bd0381e07d2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.145746 May 11 09:57:37.924344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 328/665] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:37 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:38.279515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-3d1b69ed-6233-4bf7-9e85-3b9d619e47ed req-d3f60d3b-08fd-48a3-a541-347ad1614b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05dcd92-ad7c-43e1-8679-add6e52ecb44", "name": "network-vif-plugged", "status": "completed", "tag": "a81ec2e4-8750-42eb-ad17-b890d34599ab"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:38.289264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3d1b69ed-6233-4bf7-9e85-3b9d619e47ed req-d3f60d3b-08fd-48a3-a541-347ad1614b3e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.289885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3d1b69ed-6233-4bf7-9e85-3b9d619e47ed req-d3f60d3b-08fd-48a3-a541-347ad1614b3e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.300609 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-3d1b69ed-6233-4bf7-9e85-3b9d619e47ed req-d3f60d3b-08fd-48a3-a541-347ad1614b3e service nova] Creating event network-vif-plugged:a81ec2e4-8750-42eb-ad17-b890d34599ab for instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 on hv-cinder-83699 May 11 09:57:38.305412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-3d1b69ed-6233-4bf7-9e85-3b9d619e47ed req-d3f60d3b-08fd-48a3-a541-347ad1614b3e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 May 11 09:57:38.306026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 338/666] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:38.407930 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d35ec602-42cb-4e9f-9f7c-cb3256ac4fa1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd4548b0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:38.457757 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d35ec602-42cb-4e9f-9f7c-cb3256ac4fa1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9176cbe6-a59d-4ee0-8a2f-a45cc8aa565f" status: 200 len: 351 microversion: 2.1 time: 0.054006 May 11 09:57:38.458427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 329/667] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:57:38 2022] GET /compute/v2.1/os-volumes/9176cbe6-a59d-4ee0-8a2f-a45cc8aa565f => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:38.738333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:38.739347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:38.745477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.746007 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.746675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.747104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.775846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9bbe9041-ea6f-4216-a6cf-812d84ec7bc0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041906 May 11 09:57:38.776430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 339/668] 10.222.0.44 () {60 vars in 1342 bytes} [Wed May 11 09:57:38 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:38.834288 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:38.834756 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:38.840621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.841068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.841826 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.842265 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.866370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:57:38.940023 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4b1fa9b6-3d7a-4436-8ca9-bdc7b2067c17 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 204 len: 0 microversion: 2.20 time: 0.109786 May 11 09:57:38.940511 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:38.940664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 330/669] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 09:57:38 2022] DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 11 09:57:38.941140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:38.947876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.948334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.949154 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.949608 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.950994 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:38.951786 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:38.958113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.958609 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:38.959534 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:38.960163 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:39.085540 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:39.092814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-71e6a710-323d-4188-aba0-32c17284940f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.156243 May 11 09:57:39.095837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 340/670] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:38 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:57:39.096153 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:39.103968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:39.105457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:39.106624 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c37e8faf-704b-4fc1-ae3a-0ad11dc63fb0 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.160571 May 11 09:57:39.107192 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 331/671] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:38 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:57:39.760463 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7e63c55d-2dc7-4379-ae63-fd201923c70f tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd3e6670>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:39.806374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7e63c55d-2dc7-4379-ae63-fd201923c70f tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/407cf9e6-118f-47ee-9c23-a96258f5eace" status: 200 len: 351 microversion: 2.1 time: 0.049610 May 11 09:57:39.806940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 341/672] 10.222.0.44 () {58 vars in 1244 bytes} [Wed May 11 09:57:39 2022] GET /compute/v2.1/os-volumes/407cf9e6-118f-47ee-9c23-a96258f5eace => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:39.817924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-01d88192-5b6e-465b-8cc7-31143c386626 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd415040>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:39.897019 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-01d88192-5b6e-465b-8cc7-31143c386626 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082690 May 11 09:57:39.897593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 332/673] 10.222.0.44 () {58 vars in 1133 bytes} [Wed May 11 09:57:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:39.910161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0dcdb0bd-e359-4ad4-9487-993a9ba0f814 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd3ac4c0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:39.988810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0dcdb0bd-e359-4ad4-9487-993a9ba0f814 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083282 May 11 09:57:39.989371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 342/674] 10.222.0.44 () {58 vars in 1148 bytes} [Wed May 11 09:57:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:40.001068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ae0e6b48-7208-4787-a7e1-5e5c0c0d8939 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd497dc0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.078693 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ae0e6b48-7208-4787-a7e1-5e5c0c0d8939 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.081443 May 11 09:57:40.079289 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 333/675] 10.222.0.44 () {58 vars in 1133 bytes} [Wed May 11 09:57:39 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:40.090152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-13da2848-22cd-46a9-8448-ab8c3e65869b tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd37f9d0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.109141 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.109771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:40.115741 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:40.116191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:40.116948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:40.117381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:40.171982 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-13da2848-22cd-46a9-8448-ab8c3e65869b tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085419 May 11 09:57:40.172552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 343/676] 10.222.0.44 () {58 vars in 1166 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:40.176986 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.178715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:40.183708 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:40.184161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:40.184923 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:40.185354 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:40.247272 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:40.255147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2aae1c5f-296c-4d81-b04e-1e184909582f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1367 microversion: 2.1 time: 0.149823 May 11 09:57:40.255889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 334/677] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:40.260429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-40b87da8-a941-4a73-a568-89ee22df68a1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd4e7ca0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.312340 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:40.320220 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:40.321989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:40.323205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c5f6603e-1241-461e-965f-96707d380feb tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.149755 May 11 09:57:40.323929 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 344/678] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 11 09:57:40.338702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-40b87da8-a941-4a73-a568-89ee22df68a1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.081682 May 11 09:57:40.339284 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 335/679] 10.222.0.44 () {58 vars in 1169 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:40.350963 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f0ce3787-8c3e-44d6-9feb-6bccc8f11ea6 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd3e6550>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.432234 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f0ce3787-8c3e-44d6-9feb-6bccc8f11ea6 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.085016 May 11 09:57:40.432907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 345/680] 10.222.0.44 () {58 vars in 1154 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:40.444955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7bb7265b-c743-44b9-b450-bb3e26e2e737 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd415a60>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.677073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7bb7265b-c743-44b9-b450-bb3e26e2e737 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.235831 May 11 09:57:40.677641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 336/681] 10.222.0.44 () {58 vars in 1187 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:40.690113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8e1e6744-a6fc-4ec7-aab6-4bcf341012f1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] Calling method '.version_select at 0x7f8bcd3ace50>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:40.767876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8e1e6744-a6fc-4ec7-aab6-4bcf341012f1 tempest-VolumesTestJSON-398570523 tempest-VolumesTestJSON-398570523-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082138 May 11 09:57:40.768440 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 346/682] 10.222.0.44 () {58 vars in 1154 bytes} [Wed May 11 09:57:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:41.272314 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:41.272836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:41.279317 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.279789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.281222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.281649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.341979 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:41.343412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:41.350099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.350657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.351600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.352110 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.412802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:41.420351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-51b352c4-b026-4e0e-937f-320bf7488fbb tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1557 microversion: 2.1 time: 0.152412 May 11 09:57:41.421576 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 337/683] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:57:41 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:57:41.436924 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:41.437410 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:41.443828 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.444501 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.445273 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.445915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.523538 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ab145486-28fe-4ed0-ab19-b341636bb977 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090159 May 11 09:57:41.524549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 338/684] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:57:41 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:57:41.545504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:41.553976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:41.555476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a918dc4737544f3fa38090e2c82aeae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e16bff4d8934820afea7d3345bcdc4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:57:41.556659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4ea7c6d0-6095-4585-ac06-3b8529c3acf5 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 200 len: 1721 microversion: 2.20 time: 0.219101 May 11 09:57:41.557404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 347/685] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:41 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 11 09:57:41.875497 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-e96730bf-f8c8-4250-a79f-afa6a4a76d2b req-8b39b6c1-9dc9-4949-8c2a-d0624bccc6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6cc551-b8d0-464d-95c5-0f9400c489e6", "name": "network-vif-deleted", "tag": "5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:41.884654 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-e96730bf-f8c8-4250-a79f-afa6a4a76d2b req-8b39b6c1-9dc9-4949-8c2a-d0624bccc6e0 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:41.885068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-e96730bf-f8c8-4250-a79f-afa6a4a76d2b req-8b39b6c1-9dc9-4949-8c2a-d0624bccc6e0 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:41.900614 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-e96730bf-f8c8-4250-a79f-afa6a4a76d2b req-8b39b6c1-9dc9-4949-8c2a-d0624bccc6e0 service nova] Creating event network-vif-deleted:5d6e96e2-b7fa-4b30-8942-f7d9d6f70c68 for instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 on hv-cinder-83699 May 11 09:57:41.908324 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-e96730bf-f8c8-4250-a79f-afa6a4a76d2b req-8b39b6c1-9dc9-4949-8c2a-d0624bccc6e0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036943 May 11 09:57:41.911544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 339/686] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:57:42.574303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:42.574907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:42.581653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:42.582382 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:42.583152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:42.583582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:42.597383 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 HTTP/1.1 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:57:42.599322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:42.600710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '5b6cc551-b8d0-464d-95c5-0f9400c489e6'} May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:42.601436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:42.602640 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:42.605236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:42.606802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-20087e9c-8001-44f9-be9a-fff36f1b9ce3 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 404 len: 111 microversion: 2.20 time: 0.036113 May 11 09:57:42.607904 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 348/687] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:42 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 09:57:42.618552 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fcac3ebd-c141-40c6-91d4-06d57c368d9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '.version_select at 0x7f8bcd604940>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:42.645223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fcac3ebd-c141-40c6-91d4-06d57c368d9c tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337647994" status: 204 len: 0 microversion: 2.20 time: 0.032001 May 11 09:57:42.650837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 340/688] 10.222.0.44 () {60 vars in 1261 bytes} [Wed May 11 09:57:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337647994 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 11 09:57:42.788933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-912ffb83-7b26-466e-b4d1-a55917e3c5cd req-4e7b2552-e404-4fcd-bd08-1cd1adc12dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a05dcd92-ad7c-43e1-8679-add6e52ecb44", "tag": "a81ec2e4-8750-42eb-ad17-b890d34599ab"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:57:42.809360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-912ffb83-7b26-466e-b4d1-a55917e3c5cd req-4e7b2552-e404-4fcd-bd08-1cd1adc12dbd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:42.809806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-912ffb83-7b26-466e-b4d1-a55917e3c5cd req-4e7b2552-e404-4fcd-bd08-1cd1adc12dbd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:42.826333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-912ffb83-7b26-466e-b4d1-a55917e3c5cd req-4e7b2552-e404-4fcd-bd08-1cd1adc12dbd service nova] Creating event network-changed:a81ec2e4-8750-42eb-ad17-b890d34599ab for instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 on hv-cinder-83699 May 11 09:57:42.832191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-912ffb83-7b26-466e-b4d1-a55917e3c5cd req-4e7b2552-e404-4fcd-bd08-1cd1adc12dbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189816 May 11 09:57:42.833541 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 349/689] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:57:44.722033 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:44.722595 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:44.729777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:44.730220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:44.730972 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:44.731400 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:44.744340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 HTTP/1.1 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:44.745989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.747352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '5b6cc551-b8d0-464d-95c5-0f9400c489e6'} May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:44.748308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.749592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:44.750792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:44.750792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6a4d8ab1-65f0-4226-9ff0-bb8739b63c00 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 404 len: 111 microversion: 2.20 time: 0.029894 May 11 09:57:44.750792 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 341/690] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 09:57:44 2022] DELETE /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 09:57:44.756831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:44.757515 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 5b6cc551-b8d0-464d-95c5-0f9400c489e6] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:44.763399 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:44.763882 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:44.765156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:44.765583 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:44.778744 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 HTTP/1.1 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:57:44.781070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.782798 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '5b6cc551-b8d0-464d-95c5-0f9400c489e6'} May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:44.783957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. May 11 09:57:44.785179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:44.786323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 5b6cc551-b8d0-464d-95c5-0f9400c489e6 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:44.786323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fefe591d-7a16-4c8d-8926-b20abf142e54 tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6" status: 404 len: 111 microversion: 2.20 time: 0.030224 May 11 09:57:44.786323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 350/691] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:44 2022] GET /compute/v2.1/servers/5b6cc551-b8d0-464d-95c5-0f9400c489e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 11 09:57:45.912722 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:45.913222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:45.920320 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:45.920865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:45.921641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:45.922073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:45.935239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa HTTP/1.1 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:57:45.937309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.938822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '171adcea-6dc1-4564-90ca-371a791011fa'} May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:45.939635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.941013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:57:45.942432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:45.942432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7f6567ea-0930-49c0-9e22-e5b9ec2c875e tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 404 len: 111 microversion: 2.20 time: 0.030196 May 11 09:57:45.942432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 342/692] 10.222.0.44 () {60 vars in 1279 bytes} [Wed May 11 09:57:45 2022] DELETE /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 09:57:45.947412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:57:45.948066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] [instance: 171adcea-6dc1-4564-90ca-371a791011fa] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:57:45.954939 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:45.955445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:45.956213 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:57:45.956776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:57:45.970535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] HTTP exception thrown: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Request method failure captured: May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa HTTP/1.1 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4ck7IUpHxxPC6R4zbFkAmrqqxO_Lj9D5UOs7ftd5c0dxUXjZQXTFdJgD_Cx3ekglL7cW7vxauYVEzkUApUsUfPaw4MnCujbSuR7VQ7qe-L00aw-lf5JtX2LSbE2o0YMtqzOc3xlxxTts722LoC1AwwgrnrEOJQo8k7VLN2hXTfkqY8 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Openstack-Nova-Api-Version: 2.20 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:57:45.972088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6e16bff4d8934820afea7d3345bcdc4f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6e16bff4d8934820afea7d3345bcdc4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 6e16bff4d8934820afea7d3345bcdc4f May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-704477375 May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: a918dc4737544f3fa38090e2c82aeae6 May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeShelveTestJSON-704477375-project May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.973642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '171adcea-6dc1-4564-90ca-371a791011fa'} May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:57:45.974503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. May 11 09:57:45.976131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:57:45.977826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] Returning 404 to user: Instance 171adcea-6dc1-4564-90ca-371a791011fa could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:57:45.977826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e2ed3747-f79b-4d38-a5c4-29f0f2ec137d tempest-AttachVolumeShelveTestJSON-704477375 tempest-AttachVolumeShelveTestJSON-704477375-project] 10.222.0.44 "GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa" status: 404 len: 111 microversion: 2.20 time: 0.029953 May 11 09:57:45.977826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 351/693] 10.222.0.44 () {60 vars in 1276 bytes} [Wed May 11 09:57:45 2022] GET /compute/v2.1/servers/171adcea-6dc1-4564-90ca-371a791011fa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 11 09:58:19.249077 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:19.249822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:19.255899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.256352 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.257160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.257596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.281309 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fab81e15-cce3-4f0a-bb12-3c66fd96fe4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/ips" status: 200 len: 149 microversion: 2.1 time: 0.037231 May 11 09:58:19.281871 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 343/694] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:58:19 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:19.293701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a29685f-e37a-4b0f-bc9d-ca58447ca6e6"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:19.294758 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:19.300703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.301142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.302078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.302513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.389275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: POST /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/os-volume_attachments HTTP/1.1 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 74 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:58:19.391153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {"volumeAttachment": {"volumeId": "5a29685f-e37a-4b0f-bc9d-ca58447ca6e6"}} May 11 09:58:19.392914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'server_id': 'a05dcd92-ad7c-43e1-8679-add6e52ecb44', 'body': {'volumeAttachment': {'volumeId': '5a29685f-e37a-4b0f-bc9d-ca58447ca6e6'}}} May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:19.393822 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:19.395427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 400 to user: Invalid volume: volume 5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 is already attached to instances: 4c3a8d92-c02e-49c8-b910-892dfca23b1f {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7c7a476b-8880-4df6-933f-768f0da59fb5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103087 May 11 09:58:19.396858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 352/695] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:58:19 2022] POST /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 09:58:19.402549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:19.403337 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:19.410491 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.411023 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.411835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.412342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.438018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:58:19.519993 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-cfd9ed1b-0233-45bd-a013-e872b879bf10 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 204 len: 0 microversion: 2.1 time: 0.121456 May 11 09:58:19.521079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 344/696] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:58:19 2022] DELETE /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:58:19.529323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:19.529926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:19.537480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.537938 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.538726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:19.539173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:19.669818 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:19.677167 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cb0ad54a-37d4-4a0c-a383-17e6622e9f08 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1681 microversion: 2.1 time: 0.151640 May 11 09:58:19.677729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 353/697] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:19 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:20.695607 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:20.696429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:20.703340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:20.703804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:20.704566 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:20.705006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:20.858466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:20.865916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4dabcf85-6fd3-48fa-8d71-6b036a7475c5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1681 microversion: 2.1 time: 0.174556 May 11 09:58:20.866470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 345/698] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:20 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:21.853846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-02fd14bb-bb5c-465d-9b11-ab568340c38d req-8cefbd97-c1e8-4bb5-9c90-8ad8595379d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a05dcd92-ad7c-43e1-8679-add6e52ecb44", "name": "network-vif-deleted", "tag": "a81ec2e4-8750-42eb-ad17-b890d34599ab"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:21.864585 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-02fd14bb-bb5c-465d-9b11-ab568340c38d req-8cefbd97-c1e8-4bb5-9c90-8ad8595379d4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:21.865033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-02fd14bb-bb5c-465d-9b11-ab568340c38d req-8cefbd97-c1e8-4bb5-9c90-8ad8595379d4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:21.883121 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-02fd14bb-bb5c-465d-9b11-ab568340c38d req-8cefbd97-c1e8-4bb5-9c90-8ad8595379d4 service nova] Creating event network-vif-deleted:a81ec2e4-8750-42eb-ad17-b890d34599ab for instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 on hv-cinder-83699 May 11 09:58:21.884935 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:21.885812 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:21.889505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-02fd14bb-bb5c-465d-9b11-ab568340c38d req-8cefbd97-c1e8-4bb5-9c90-8ad8595379d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 May 11 09:58:21.897286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 354/699] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:21.901184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:21.908110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:21.914579 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:21.916293 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:22.017188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:22.025620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d1623ff4-b782-4f61-af22-189e4714ef64 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 200 len: 1327 microversion: 2.1 time: 0.144991 May 11 09:58:22.026488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 346/700] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:21 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:23.045719 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:23.046522 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:23.053655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.054152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.055019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.055523 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.068968 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 HTTP/1.1 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:58:23.070654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 09:58:23.072101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'a05dcd92-ad7c-43e1-8679-add6e52ecb44'} May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:58:23.072821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 09:58:23.074016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:23.075123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:58:23.075123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7ade2ad0-392e-4c1a-a0ee-4fe54966de95 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 404 len: 111 microversion: 2.1 time: 0.032429 May 11 09:58:23.075123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 355/701] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:23 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 09:58:23.081230 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-54dd322d-c49a-4c4f-b5b0-35b17c2b8b3f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '.version_select at 0x7f8bcd4e71f0>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:23.100526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-54dd322d-c49a-4c4f-b5b0-35b17c2b8b3f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550609919" status: 202 len: 0 microversion: 2.1 time: 0.022882 May 11 09:58:23.102188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 347/702] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 09:58:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550609919 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:58:23.743202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:23.743722 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:23.750032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.750477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.751238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.751706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.831286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lazy-loading 'services' on Instance uuid 4c3a8d92-c02e-49c8-b910-892dfca23b1f {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:58:23.902389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a96e9b6d-c722-4709-a8b7-df405d7b9eff tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments/5a29685f-e37a-4b0f-bc9d-ca58447ca6e6" status: 202 len: 0 microversion: 2.1 time: 0.162892 May 11 09:58:23.903008 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 356/703] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:58:23 2022] DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments/5a29685f-e37a-4b0f-bc9d-ca58447ca6e6 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:58:23.912564 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:23.913507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:23.920714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.921366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.923070 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:23.923707 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:23.957449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-747e6fe5-343e-4c5b-91e8-61581b9e6db7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 May 11 09:58:23.958192 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 348/704] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:58:23 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:24.970881 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:24.971911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:24.977957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:24.978401 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:24.979159 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:24.979588 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:25.007412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9a191f12-e9de-46cf-8001-725b3004f44c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041916 May 11 09:58:25.008004 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 357/705] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:58:24 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:26.018600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:26.019517 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:26.025876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:26.026320 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:26.027073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:26.027500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:26.058292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8486899f-8dca-490a-95d9-543d5a59d906 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 May 11 09:58:26.058944 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 349/706] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:58:26 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:27.069176 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:27.070241 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:27.076487 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.076942 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.077713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.078150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.105947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11484ee7-469d-4e4e-bbc7-db3765c6f43f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040648 May 11 09:58:27.106513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 358/707] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:58:27 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:58:27.163671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:27.164200 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:27.170864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.171306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.172092 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.172521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.197590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:58:27.276795 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-0a6664dd-56e1-4945-866e-32a21c04cbc7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 204 len: 0 microversion: 2.1 time: 0.116502 May 11 09:58:27.277607 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 350/708] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:58:27 2022] DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:58:27.286530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:27.287136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:27.293037 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.293492 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.294755 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:27.295190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:27.428409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:27.435938 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1326ae67-c46d-4687-be66-ef6da57f2347 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1684 microversion: 2.1 time: 0.153209 May 11 09:58:27.436496 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 359/709] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:27 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:28.456145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:28.457544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:28.466258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:28.466590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:28.468047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:28.468383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:28.604066 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:28.612912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b2aec02e-ee5d-40cd-bce3-b70621ac796f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1684 microversion: 2.1 time: 0.162755 May 11 09:58:28.613585 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 351/710] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:28 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:29.631845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:29.632521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:29.642033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:29.642499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:29.643323 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:29.643866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:29.744624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:29.756265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-47871e8e-2957-47d7-a992-e1064dd073b0 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 200 len: 1616 microversion: 2.1 time: 0.128386 May 11 09:58:29.757094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 360/711] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:29 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 1616 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:30.137068 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-6d9a47f1-2a3c-45ad-bdcb-fde2682a2b5e req-be2b63fd-440d-4059-9003-6fd699671370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c3a8d92-c02e-49c8-b910-892dfca23b1f", "name": "network-vif-deleted", "tag": "b07f9725-379d-4fd2-bd3c-580a32596a84"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:30.154174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-6d9a47f1-2a3c-45ad-bdcb-fde2682a2b5e req-be2b63fd-440d-4059-9003-6fd699671370 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:30.157503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-6d9a47f1-2a3c-45ad-bdcb-fde2682a2b5e req-be2b63fd-440d-4059-9003-6fd699671370 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:30.181044 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-6d9a47f1-2a3c-45ad-bdcb-fde2682a2b5e req-be2b63fd-440d-4059-9003-6fd699671370 service nova] Creating event network-vif-deleted:b07f9725-379d-4fd2-bd3c-580a32596a84 for instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f on hv-cinder-83699 May 11 09:58:30.194333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-6d9a47f1-2a3c-45ad-bdcb-fde2682a2b5e req-be2b63fd-440d-4059-9003-6fd699671370 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058021 May 11 09:58:30.196462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 352/712] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:30.775439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:30.777249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:30.796825 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:30.797757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:30.798859 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:30.799451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:30.817266 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f HTTP/1.1 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:58:30.819224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 09:58:30.821079 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '4c3a8d92-c02e-49c8-b910-892dfca23b1f'} May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:58:30.821934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 09:58:30.823402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:58:30.824775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:58:30.824775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-110d37ce-8b1d-4eb3-8c2b-00a54b57c435 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 404 len: 111 microversion: 2.1 time: 0.051498 May 11 09:58:30.826810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 361/713] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:30 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 09:58:30.832221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-94fd380f-3b48-4330-935c-83216f3d09a6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '.version_select at 0x7f8bcd384940>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:30.863476 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-94fd380f-3b48-4330-935c-83216f3d09a6 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321108736" status: 202 len: 0 microversion: 2.1 time: 0.035378 May 11 09:58:30.865927 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 353/714] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 09:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321108736 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:58:31.862353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-76db19c1-7ec1-4ae4-9d5c-682e416b71e2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: .version_select at 0x7f8bcd43f280>, body: {"keypair": {"name": "tempest-keypair-134438894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzG55rhoCh8Bs8bnaS67027dd0yMdEM8akMKYzJ+ceYWl8pMmlSXkff7SzcH6AARv79Q2zIkkOX+s7M08Cdwb8F02bQD48QD5rFb3kZ/YG177MP0DaB60oyOYiyxki4zQ=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:31.880368 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-76db19c1-7ec1-4ae4-9d5c-682e416b71e2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:58:31.884556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-76db19c1-7ec1-4ae4-9d5c-682e416b71e2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:58:31.909506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-76db19c1-7ec1-4ae4-9d5c-682e416b71e2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050771 May 11 09:58:31.910417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 362/715] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:58:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:33.686383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-741752660", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c5000ec-9218-43b8-af63-690179d5f88f"}], "security_groups": [{"name": "tempest-securitygroup--778025226"}], "key_name": "tempest-keypair-134438894", "user_data": "}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:33.819623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] validate_networks() for [('2c5000ec-9218-43b8-af63-690179d5f88f', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:58:34.360690 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:58:34.361452 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:58:34.362869 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:58:34.363640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:58:34.364604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:58:34.389797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:34.390507 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:34.391486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:34.392901 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:34.413139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:58:34.417407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:58:34.429264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:58:34.431652 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:58:34.480327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-28b3f4b8-d0fe-4774-827c-7c47d08f1aca tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.799172 May 11 09:58:34.481322 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 354/716] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:58:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:58:34.490873 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-95ed80a0-55ca-4e6c-a2aa-f34f186ae5e7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:34.492425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-95ed80a0-55ca-4e6c-a2aa-f34f186ae5e7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:34.561960 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-95ed80a0-55ca-4e6c-a2aa-f34f186ae5e7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:34.568673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-95ed80a0-55ca-4e6c-a2aa-f34f186ae5e7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1240 microversion: 2.1 time: 0.081752 May 11 09:58:34.569408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 363/717] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:34 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:58:35.598801 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:35.599814 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:35.613331 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:35.615960 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:35.619054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:35.620383 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:35.735766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:35.745154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ec021a03-d5a5-4adf-8683-d83421260db5 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1310 microversion: 2.1 time: 0.161663 May 11 09:58:35.745937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 355/718] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:35 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:36.764301 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:36.765347 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:36.793312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:36.805704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:36.806992 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:36.807676 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:37.293641 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:37.303834 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-428f3665-d766-4d2d-a76d-e30d2f69b548 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.543727 May 11 09:58:37.305402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 364/719] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:36 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:38.142272 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-5c15ee05-e58f-40f8-a208-f4c88868b7a7 req-7912046e-4d17-470b-9f8c-d322535afa18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0783e6f-7401-405a-bc36-77d27ebad679", "tag": "5f21fe21-c736-4f08-b44d-0ccc6419ea6b"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:38.180423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5c15ee05-e58f-40f8-a208-f4c88868b7a7 req-7912046e-4d17-470b-9f8c-d322535afa18 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:38.183372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5c15ee05-e58f-40f8-a208-f4c88868b7a7 req-7912046e-4d17-470b-9f8c-d322535afa18 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:38.219426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-5c15ee05-e58f-40f8-a208-f4c88868b7a7 req-7912046e-4d17-470b-9f8c-d322535afa18 service nova] Creating event network-changed:5f21fe21-c736-4f08-b44d-0ccc6419ea6b for instance b0783e6f-7401-405a-bc36-77d27ebad679 on hv-cinder-83699 May 11 09:58:38.227424 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-5c15ee05-e58f-40f8-a208-f4c88868b7a7 req-7912046e-4d17-470b-9f8c-d322535afa18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098447 May 11 09:58:38.228446 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 356/720] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:58:38.324439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:38.327613 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:38.348476 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:38.349326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:38.351970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:38.352441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:38.707746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:38.720651 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-93469a37-e843-4794-9999-4de0b91c2a72 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.402655 May 11 09:58:38.722992 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 365/721] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:38 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:39.739032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:39.740469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:39.746852 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:39.748783 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:39.749757 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:39.750405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:39.945820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:39.954370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a4254922-6515-433b-aee6-e8c57326f556 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.219831 May 11 09:58:39.967801 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 357/722] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:39 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:40.976330 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:40.976948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:40.985391 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:40.985846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:40.986658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:40.987284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:41.273481 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:41.281606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f0d0b44f-8f1d-47d6-bed3-3955c50529f7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.312625 May 11 09:58:41.292308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 366/723] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:40 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:42.299985 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:42.301992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:42.311951 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:42.312670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:42.314211 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:42.314846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:42.561530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:42.573737 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4d8aa179-4a8b-4802-8888-d34b45ed53ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.279158 May 11 09:58:42.585136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 358/724] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:42 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:43.592138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:43.593427 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:43.605393 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:43.614349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:43.616436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:43.622152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:43.901804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:43.916458 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0223178c-fd7d-4990-bcbe-92dc8204b062 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.328686 May 11 09:58:43.924533 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 367/725] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:43 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:44.941116 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:44.941647 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:44.956230 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:44.956471 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:44.957245 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:44.957761 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:45.136903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-b1c3609a-0d8e-470a-909a-db31d542d3d7 req-05a4059a-e9d1-4062-bae2-e9eb11b898ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0783e6f-7401-405a-bc36-77d27ebad679", "name": "network-vif-plugged", "status": "completed", "tag": "5f21fe21-c736-4f08-b44d-0ccc6419ea6b"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:45.149945 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b1c3609a-0d8e-470a-909a-db31d542d3d7 req-05a4059a-e9d1-4062-bae2-e9eb11b898ed service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:45.150393 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-b1c3609a-0d8e-470a-909a-db31d542d3d7 req-05a4059a-e9d1-4062-bae2-e9eb11b898ed service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:45.168682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-b1c3609a-0d8e-470a-909a-db31d542d3d7 req-05a4059a-e9d1-4062-bae2-e9eb11b898ed service nova] Creating event network-vif-plugged:5f21fe21-c736-4f08-b44d-0ccc6419ea6b for instance b0783e6f-7401-405a-bc36-77d27ebad679 on hv-cinder-83699 May 11 09:58:45.174917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-b1c3609a-0d8e-470a-909a-db31d542d3d7 req-05a4059a-e9d1-4062-bae2-e9eb11b898ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043327 May 11 09:58:45.175889 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 368/726] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:58:45.282240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:45.290056 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fffabe5d-3dbb-4cd0-a498-08752df832df tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.352749 May 11 09:58:45.290660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 359/727] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:44 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:46.240519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aea543d9-f188-4961-82ce-f4cf0072074e tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Action: 'create', calling method: .version_select at 0x7f8bcd39e430>, body: {"keypair": {"name": "tempest-TestShelveInstance-615077066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAflx3T7nHNmkwaxlxgYLDPzNKkuNF58fIVlaM/GIZ++SzjdD2380o5oFRkMZd7tQtAVrJ5h1MkwDqFR4O9oEo7J3oOSsLPMtGJSSbTIjSvcq8Nr5yHzPTISIeRk0wpnMQ=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:46.253859 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-aea543d9-f188-4961-82ce-f4cf0072074e tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Getting quotas for project 581a43958ce14c81832b5f1bf5622763. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:58:46.258397 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-aea543d9-f188-4961-82ce-f4cf0072074e tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Getting quotas for user 8034a3f2eff04f798aad85721934c024 and project 581a43958ce14c81832b5f1bf5622763. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:58:46.282619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aea543d9-f188-4961-82ce-f4cf0072074e tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.259154 May 11 09:58:46.283545 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 369/728] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:58:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:46.306616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:46.307912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:46.314691 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:46.315348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:46.316311 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:46.316996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:46.579440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:46.595057 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-be54c9e8-ef0c-481f-8a8b-f309478b8c5c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1365 microversion: 2.1 time: 0.291075 May 11 09:58:46.602968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 360/729] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:46 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:47.612254 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:47.621782 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:47.631739 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:47.632128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:47.633059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:47.633506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:47.798333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:58:47.811443 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-586dddd8-0261-47fd-90a3-f31636cca012 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1556 microversion: 2.1 time: 0.205020 May 11 09:58:47.812135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 370/730] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:58:47 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:58:47.837906 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:58:47.839818 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:58:47.846086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:47.846534 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:47.847305 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:47.859794 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:48.014527 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ae629c6b-1cc7-4080-9d1a-642085e661bf tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185169 May 11 09:58:48.015493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 361/731] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:58:47 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:58:49.377908 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-65c94d2f-07d1-42b8-aa64-7663204c24b8 req-d109b671-1528-48fc-8c7e-ae0ac8b8e8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0783e6f-7401-405a-bc36-77d27ebad679", "tag": "5f21fe21-c736-4f08-b44d-0ccc6419ea6b"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:58:49.388528 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-65c94d2f-07d1-42b8-aa64-7663204c24b8 req-d109b671-1528-48fc-8c7e-ae0ac8b8e8b1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:58:49.389656 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-65c94d2f-07d1-42b8-aa64-7663204c24b8 req-d109b671-1528-48fc-8c7e-ae0ac8b8e8b1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:58:49.404380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-65c94d2f-07d1-42b8-aa64-7663204c24b8 req-d109b671-1528-48fc-8c7e-ae0ac8b8e8b1 service nova] Creating event network-changed:5f21fe21-c736-4f08-b44d-0ccc6419ea6b for instance b0783e6f-7401-405a-bc36-77d27ebad679 on hv-cinder-83699 May 11 09:58:49.412989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-65c94d2f-07d1-42b8-aa64-7663204c24b8 req-d109b671-1528-48fc-8c7e-ae0ac8b8e8b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039005 May 11 09:58:49.413749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 371/732] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:59:02.031460 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-981262857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-615077066", "security_groups": [{"name": "tempest-secgroup-smoke-1805715854"}], "networks": [{"uuid": "da95db1a-da88-4312-a046-f218f2bce034"}], "block_device_mapping_v2": [{"uuid": "e259e210-6ac6-468e-bcd4-b0ba2a8052f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:02.413260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.network.neutron [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] validate_networks() for [('da95db1a-da88-4312-a046-f218f2bce034', None, None, None, None, None)] {{(pid=123393) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:59:03.132095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Flavor limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:59:03.133733 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Image limits 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:59:03.134209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Flavor pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:59:03.134623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Image pref 0:0:0 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:59:03.135031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.virt.hardware [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123393) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:59:03.152958 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:03.153856 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:03.155060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:03.155797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:03.192343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Getting quotas for project 581a43958ce14c81832b5f1bf5622763. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:59:03.198188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Getting quotas for user 8034a3f2eff04f798aad85721934c024 and project 581a43958ce14c81832b5f1bf5622763. Resources: {'instances', 'cores', 'ram'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:59:03.293983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Going to run 1 instances... {{(pid=123393) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:59:03.296788 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e259e210-6ac6-468e-bcd4-b0ba2a8052f4',volume_size=None,volume_type=None)] {{(pid=123393) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:59:03.521923 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dfb60112-9fbe-4f40-b41e-1aaf9950a9bb tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.494851 May 11 09:59:03.523739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 362/733] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:59:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:59:03.536687 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7f83005b-2362-43be-b74b-faf228be43ed tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:03.537380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7f83005b-2362-43be-b74b-faf228be43ed tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:03.612686 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7f83005b-2362-43be-b74b-faf228be43ed tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:03.619388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7f83005b-2362-43be-b74b-faf228be43ed tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1087 microversion: 2.1 time: 0.086761 May 11 09:59:03.620312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 372/734] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:03 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1087 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:04.637550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:04.639049 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:04.645956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:04.646691 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:04.647994 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:04.648862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:04.736198 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:04.745051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4404512d-6d85-402e-bbf2-78a976498467 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1185 microversion: 2.1 time: 0.110864 May 11 09:59:04.745833 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 363/735] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:04 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:05.762333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:05.763845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:05.770413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:05.786795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:05.788759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:05.789170 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:06.026608 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:06.041212 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d66e49e8-18d4-412e-9746-9a9f090371af tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.282172 May 11 09:59:06.043628 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 373/736] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:05 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:07.060308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:07.061548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:07.072670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:07.073413 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:07.074350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:07.078380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:07.110724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-f4a2de81-753e-4917-9796-655b5da7a774 req-8d511f6d-f486-42a1-a3ea-341070399baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:07.123606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-f4a2de81-753e-4917-9796-655b5da7a774 req-8d511f6d-f486-42a1-a3ea-341070399baf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:07.124110 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-f4a2de81-753e-4917-9796-655b5da7a774 req-8d511f6d-f486-42a1-a3ea-341070399baf service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:07.148171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-f4a2de81-753e-4917-9796-655b5da7a774 req-8d511f6d-f486-42a1-a3ea-341070399baf service nova] Creating event network-changed:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 09:59:07.158829 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-f4a2de81-753e-4917-9796-655b5da7a774 req-8d511f6d-f486-42a1-a3ea-341070399baf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051584 May 11 09:59:07.159678 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 374/737] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:07.354697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:07.362449 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6ab64db1-e3ab-45d2-9b83-334a4a122647 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.306714 May 11 09:59:07.363028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 364/738] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:07 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:08.383409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:08.384805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:08.400362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:08.401136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:08.402088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:08.402675 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:08.640435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:08.651445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c82bb1d8-14f4-47b6-bee7-a1603fa5beb5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.272304 May 11 09:59:08.652611 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 375/739] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:08 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:09.670461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:09.671076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:09.677749 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:09.678188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:09.681598 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:09.682308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:09.847462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:09.857315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-455ea74f-3736-454a-a1b0-ee108702e3c5 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.191187 May 11 09:59:09.858389 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 365/740] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:09 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:10.874948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:10.875562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:10.883639 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:10.884117 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:10.884896 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:10.885331 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:11.025245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:11.033851 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4f887456-73e5-44a7-b427-4b2aa597e493 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.163206 May 11 09:59:11.034652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 376/741] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:10 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:12.050970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:12.051488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:12.058263 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:12.058708 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:12.059470 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:12.062689 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:12.218416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:12.225880 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4de0f190-a630-4fad-93c9-714e56cad1ea tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.178752 May 11 09:59:12.226633 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 366/742] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:12 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:13.242249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:13.243005 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:13.250390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:13.251010 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:13.251834 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:13.252269 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:13.395028 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:13.402631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-240f4931-d886-4778-bfec-01accc542442 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.164195 May 11 09:59:13.414806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 377/743] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:13 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:14.419954 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:14.420626 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:14.431098 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:14.431670 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:14.432604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:14.433044 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:14.437308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-53b6e33a-405b-4c32-b1cf-1ee8b1aa6eb3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'create', calling method: .version_select at 0x7f8bcd43f1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1032337737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYcPlIaeIv9W2byfab7wBbvV71zorEoB2huRsaHypHkeQD4/UyinAVIZmnT8zEwqBcCRSXTstxUK1pvRjS7F0k/ivoxNTPQiXcQZXtlRACHp1NEZQNqejZNqUExsKHCrA=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:14.450610 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-53b6e33a-405b-4c32-b1cf-1ee8b1aa6eb3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Getting quotas for project 5dbe901a83894751a9857a411986025a. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:59:14.454354 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-53b6e33a-405b-4c32-b1cf-1ee8b1aa6eb3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Getting quotas for user d1c854066d8a4cb99f7f5b1647561e53 and project 5dbe901a83894751a9857a411986025a. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:59:14.476258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-53b6e33a-405b-4c32-b1cf-1ee8b1aa6eb3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.042928 May 11 09:59:14.476879 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 378/744] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:59:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:14.524325 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1852153553", "imageRef": "f31af6ca-0f93-4f75-af60-99fc6eafb570", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1032337737", "networks": [{"uuid": "eb0f419c-81d5-4b45-8024-b111ea4ec09a"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:14.566931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:14.574313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] validate_networks() for [('eb0f419c-81d5-4b45-8024-b111ea4ec09a', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:59:14.574860 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-aaeac509-da0b-4958-8be8-e36af5f29229 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.159181 May 11 09:59:14.575481 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 367/745] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:14 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:14.938033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:59:14.938455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:59:14.938928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:59:14.939338 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:59:14.939778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:59:14.948407 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:14.948856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:14.949663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:14.950099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:14.967186 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Getting quotas for project 5dbe901a83894751a9857a411986025a. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:59:14.971074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Getting quotas for user d1c854066d8a4cb99f7f5b1647561e53 and project 5dbe901a83894751a9857a411986025a. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:59:14.981769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:59:14.983951 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f31af6ca-0f93-4f75-af60-99fc6eafb570',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:59:15.030271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-63252080-61bd-435b-976f-ff7855963808 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509721 May 11 09:59:15.031013 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 379/746] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:59:15.040832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a5f3664e-a41d-4fc9-a884-95728c87d376 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:15.041448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a5f3664e-a41d-4fc9-a884-95728c87d376 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:15.096055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a5f3664e-a41d-4fc9-a884-95728c87d376 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:15.103864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a5f3664e-a41d-4fc9-a884-95728c87d376 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1259 microversion: 2.1 time: 0.066769 May 11 09:59:15.104660 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 368/747] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:15 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:15.592444 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:15.593022 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:15.599617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:15.600114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:15.600901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:15.601341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:15.734468 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:15.741710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fd245374-8658-4d17-ba74-8f623a2269df tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.153853 May 11 09:59:15.742270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 380/748] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:15 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:16.120010 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:16.120623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:16.127884 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:16.128336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:16.129107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:16.129541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:16.195566 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:16.203430 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5d8d4b59-813a-418d-9d34-d8a9ef5c0dde tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1317 microversion: 2.1 time: 0.087102 May 11 09:59:16.204296 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 369/749] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:16 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1317 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:16.759424 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:16.760654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:16.770363 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:16.771204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:16.772599 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:16.773279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:16.994625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-cccde98b-ddea-46e0-9888-f06f212de580 req-09bbded8-af83-404b-8c47-82d390cb2801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "name": "network-vif-plugged", "status": "completed", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:17.009054 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-cccde98b-ddea-46e0-9888-f06f212de580 req-09bbded8-af83-404b-8c47-82d390cb2801 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:17.011494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-cccde98b-ddea-46e0-9888-f06f212de580 req-09bbded8-af83-404b-8c47-82d390cb2801 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:17.012344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:17.025478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-404fad90-1e3b-44a4-8c3e-ef04776d388a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.270814 May 11 09:59:17.026763 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 381/750] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:16 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:17.031612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-cccde98b-ddea-46e0-9888-f06f212de580 req-09bbded8-af83-404b-8c47-82d390cb2801 service nova] Creating event network-vif-plugged:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 09:59:17.048849 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-cccde98b-ddea-46e0-9888-f06f212de580 req-09bbded8-af83-404b-8c47-82d390cb2801 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058085 May 11 09:59:17.054625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 370/751] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:59:17.220656 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:17.221236 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:17.227647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:17.228125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:17.228893 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:17.229321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:17.361606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:17.369173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-549223fe-a40c-4a74-bab2-b3570a2eb18a tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.152309 May 11 09:59:17.369795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 382/752] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:17 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:18.045306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:18.046176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:18.056247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:18.056692 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:18.057473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:18.057903 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:18.209659 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:18.218291 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b753d105-b93b-4e13-b6ee-65af824ae0d2 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.179459 May 11 09:59:18.219089 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 371/753] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:18 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:18.386362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:18.387104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:18.398462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:18.398908 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:18.399746 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:18.400248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:18.536807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:18.544905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-aaa79d6b-7fd8-4b32-b3a0-cef8f09e0337 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.161771 May 11 09:59:18.545520 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 383/754] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:18 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:19.235368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:19.236080 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:19.242841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:19.243295 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:19.244103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:19.244542 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:19.394216 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:19.403765 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3b319258-ca2f-4988-9202-89e4196b6a45 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.172669 May 11 09:59:19.404584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 372/755] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:19 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:19.561712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:19.562326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:19.569423 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:19.570141 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:19.570917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:19.571348 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:19.703084 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:19.711474 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-59e35edc-667b-4375-a20a-6f3786bfe368 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.153616 May 11 09:59:19.712349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 384/756] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:19 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:20.421344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:20.422040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:20.429571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:20.430013 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:20.430813 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:20.431242 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:20.568551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:20.576299 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5803c761-bc84-4e23-8d86-bb244e258de7 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.159407 May 11 09:59:20.577206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 373/757] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:20 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:20.729004 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:20.729711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:20.737497 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:20.737945 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:20.738728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:20.746778 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:20.881390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:20.889142 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a870e84d-0cc9-4b63-9135-51f0458a03ad tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.164045 May 11 09:59:20.889728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 385/758] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:20 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:21.593480 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:21.594055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:21.600515 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:21.600965 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:21.601735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:21.602171 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:21.750859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:21.758320 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7b7f9994-dc6e-4425-9f52-1d4ae052b294 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.168900 May 11 09:59:21.758889 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 374/759] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:21 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:21.906668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:21.907568 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:21.913911 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:21.914362 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:21.915128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:21.915570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:22.063876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:22.071328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c3f47d16-6346-48ed-9479-30bfb9c7297e tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.169018 May 11 09:59:22.071927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 386/760] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:21 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:22.778200 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:22.779095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:22.786129 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:22.786593 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:22.787396 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:22.787862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:22.925329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:22.932945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c6c232bd-2fa8-4509-a9e9-ea1bc1ede5e9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.160223 May 11 09:59:22.933815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 375/761] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:22 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:23.089179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:23.089745 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:23.096865 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:23.097446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:23.098240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:23.098666 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:23.235259 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:23.242662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8aed0031-41e9-4d22-a045-82547d0cabd2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.157342 May 11 09:59:23.246031 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 387/762] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:23 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:23.950026 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:23.951274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:23.957966 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:23.958418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:23.959619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:23.960149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:24.093331 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:24.100583 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ed3efe69-8892-4490-8eb6-de99ba91b505 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.154480 May 11 09:59:24.101180 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 376/763] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:23 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:24.260551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:24.261187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:24.267489 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:24.267926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:24.268711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:24.269140 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:24.424090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:24.431725 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-220689af-e617-4e58-95a0-021d2ba19ddc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.174896 May 11 09:59:24.432322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 388/764] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:24 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:25.086578 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-5e6a3a54-fcb0-4ab1-972a-ae10d1cee745 req-53cf0490-703d-429b-bec6-822ae490616d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:25.100165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5e6a3a54-fcb0-4ab1-972a-ae10d1cee745 req-53cf0490-703d-429b-bec6-822ae490616d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:25.100165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5e6a3a54-fcb0-4ab1-972a-ae10d1cee745 req-53cf0490-703d-429b-bec6-822ae490616d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:25.115264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-5e6a3a54-fcb0-4ab1-972a-ae10d1cee745 req-53cf0490-703d-429b-bec6-822ae490616d service nova] Creating event network-changed:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 09:59:25.119800 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:25.120467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-5e6a3a54-fcb0-4ab1-972a-ae10d1cee745 req-53cf0490-703d-429b-bec6-822ae490616d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 May 11 09:59:25.121474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 377/765] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:25.122876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:25.129561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:25.130020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:25.130804 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:25.131239 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:25.273150 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:25.280949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2e2557a1-22b4-48a7-98fd-86b54bc9d619 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1259 microversion: 2.1 time: 0.166644 May 11 09:59:25.281510 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 389/766] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:25 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:59:25.449295 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:25.449984 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:25.456625 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:25.457061 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:25.457816 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:25.458239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:25.584776 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:25.592169 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b43065a7-1c69-4394-af16-a4a09dc372a0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.146948 May 11 09:59:25.592730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 378/767] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:25 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:26.297681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:26.298288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:26.304591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.305033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.305816 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.306246 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.494617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:26.502480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-091fb83a-f943-4ad6-8f0c-578d7a3180c0 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1444 microversion: 2.1 time: 0.208439 May 11 09:59:26.502971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 390/768] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:26 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:59:26.518861 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:26.519571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:26.525908 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.526363 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.527130 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.527567 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.609366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:26.609970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:26.615889 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.616334 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.617090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.617517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.655494 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:26.663063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ba16092c-cda0-4922-82df-9f10c268ff40 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1444 microversion: 2.1 time: 0.148036 May 11 09:59:26.663628 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 379/769] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:26 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:26.748300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:26.756536 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-16ca8d8e-0941-4f05-8454-6485da39e7e3 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.151633 May 11 09:59:26.757127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 391/770] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:26 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:59:26.808659 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:26.809147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:26.815025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.815465 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.816256 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:26.816747 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:26.847776 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a5a28d9a-e6ba-4d26-8079-c26e65d23c66 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/ips" status: 200 len: 151 microversion: 2.1 time: 0.043031 May 11 09:59:26.848343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 380/771] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 09:59:26 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:27.776178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:27.777414 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:27.784499 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:27.785097 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:27.786072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:27.786540 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:27.949880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:27.957513 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7116371d-a26e-4c43-9400-513a41fd7141 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.185869 May 11 09:59:27.958100 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 392/772] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:27 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:28.170937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:28.172531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:28.179457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:28.180231 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:28.181012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:28.181611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:28.468550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-010199db-90c4-4e88-8fa5-72bb4db576ab tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301788 May 11 09:59:28.473635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 381/773] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:59:28 2022] POST /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:28.770490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-aa2c1119-f849-4169-b76b-b9ae19f3ddce req-2373e38f-2baf-422d-8d54-d19a3b1d0c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:28.779658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aa2c1119-f849-4169-b76b-b9ae19f3ddce req-2373e38f-2baf-422d-8d54-d19a3b1d0c6e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:28.780354 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-aa2c1119-f849-4169-b76b-b9ae19f3ddce req-2373e38f-2baf-422d-8d54-d19a3b1d0c6e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:28.792516 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-aa2c1119-f849-4169-b76b-b9ae19f3ddce req-2373e38f-2baf-422d-8d54-d19a3b1d0c6e service nova] Creating event network-changed:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 09:59:28.798824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-aa2c1119-f849-4169-b76b-b9ae19f3ddce req-2373e38f-2baf-422d-8d54-d19a3b1d0c6e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032580 May 11 09:59:28.799726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 393/774] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:28.974998 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:28.976105 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:28.984261 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:28.984976 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:28.986006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:28.986663 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:29.157596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:29.165841 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b46a5c28-f308-4b44-b756-b25c4135b6e9 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.195165 May 11 09:59:29.167773 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 382/775] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:28 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:30.184122 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:30.185388 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:30.191453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:30.191926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:30.192683 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:30.193115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:30.321719 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:30.328851 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-22cd1071-0466-43d9-8d29-07c98d23c066 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.149354 May 11 09:59:30.329416 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 394/776] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:30 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:30.878155 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-5a565e2f-b241-4ad0-9fe0-4ea31a4cf5e9 req-11bbe108-fb37-4390-b671-d8a6e4277dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "name": "network-vif-plugged", "status": "completed", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:30.886581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5a565e2f-b241-4ad0-9fe0-4ea31a4cf5e9 req-11bbe108-fb37-4390-b671-d8a6e4277dcd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:30.887014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-5a565e2f-b241-4ad0-9fe0-4ea31a4cf5e9 req-11bbe108-fb37-4390-b671-d8a6e4277dcd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:30.898757 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-5a565e2f-b241-4ad0-9fe0-4ea31a4cf5e9 req-11bbe108-fb37-4390-b671-d8a6e4277dcd service nova] Creating event network-vif-plugged:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 09:59:30.903466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-5a565e2f-b241-4ad0-9fe0-4ea31a4cf5e9 req-11bbe108-fb37-4390-b671-d8a6e4277dcd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028924 May 11 09:59:30.904621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 383/777] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:31.345658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:31.346270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:31.352223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:31.352668 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:31.353430 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:31.353866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:31.485764 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:31.493007 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c1915907-643d-4b3d-be64-240b781f7774 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1359 microversion: 2.1 time: 0.151325 May 11 09:59:31.493567 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 395/778] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:31 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:32.511168 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:32.511861 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:32.518486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.518936 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.519714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.520184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.649467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:32.656671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7d556b56-c628-4afd-b576-7a0d867a6ffc tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1548 microversion: 2.1 time: 0.150264 May 11 09:59:32.657509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 384/779] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:32 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:32.672554 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:32.673192 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:32.679409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.679894 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.680650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.681075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.804209 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:32.811956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86b90975-2e94-4866-b9f7-7f50810aafcd tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1548 microversion: 2.1 time: 0.142642 May 11 09:59:32.812525 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 396/780] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:32 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1548 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:32.829060 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:32.832441 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:32.833196 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Searching by: {'deleted': False, 'project_id': '5dbe901a83894751a9857a411986025a'} {{(pid=123393) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 11 09:59:32.839601 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.840073 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.840859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:32.841284 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:32.928713 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.multi_cell_list [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123393) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 11 09:59:33.018381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e110124-264f-4f32-89ad-c49573c5c888 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.193886 May 11 09:59:33.018954 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 385/781] 10.222.0.44 () {58 vars in 1124 bytes} [Wed May 11 09:59:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:33.029171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:33.029774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:33.035828 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:33.036273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:33.037024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:33.037450 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:33.163580 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:33.171462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2be82a3f-fcc6-4065-9074-40bceab6a5ec tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1548 microversion: 2.1 time: 0.145537 May 11 09:59:33.172059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 397/782] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:33 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:34.662897 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4202a806-4011-4d9d-9108-d3ad5689264c"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:34.664023 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:34.670267 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:34.670724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:34.671495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:34.671961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:34.899844 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:34.900917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:34.908775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:34.909446 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:34.910329 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:34.910448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-57083d02-ffcb-4ebe-913c-d83166ad7670 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251378 May 11 09:59:34.911003 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:34.911136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 386/783] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:59:34 2022] POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:34.996129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: POST /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments HTTP/1.1 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 74 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 09:59:34.997827 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {"volumeAttachment": {"volumeId": "36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd"}} May 11 09:59:35.000075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'server_id': 'b0783e6f-7401-405a-bc36-77d27ebad679', 'body': {'volumeAttachment': {'volumeId': '36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd'}}} May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:59:35.001179 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:35.002548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 400 to user: Invalid volume: volume 36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd is already attached to instances: b0783e6f-7401-405a-bc36-77d27ebad679 {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4d9c8a3d-aabd-41d3-9e7a-a8f3554cdb46 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104352 May 11 09:59:35.003797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 398/784] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 09:59:34 2022] POST /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 11 09:59:35.059991 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:35.060599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:35.067276 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:35.067742 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:35.068509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:35.068946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:35.149445 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lazy-loading 'services' on Instance uuid b0783e6f-7401-405a-bc36-77d27ebad679 {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 09:59:35.216928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-96a6a7b1-106f-404a-b709-60199d86a4d7 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments/36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd" status: 202 len: 0 microversion: 2.1 time: 0.161870 May 11 09:59:35.217867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 387/785] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 09:59:35 2022] DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments/36dea174-1cdd-4cf8-9abc-c35a4b4dd9dd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:59:35.225976 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:35.226981 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:35.233024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:35.233998 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:35.234844 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:35.235394 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:35.265833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cfed581c-f762-4c3b-be06-a014ab84868e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 May 11 09:59:35.266409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 399/786] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:35 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:59:36.278087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:36.279178 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:36.286508 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:36.286958 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:36.287740 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:36.288172 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:36.316380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-bdd86ce4-a3e3-4e21-9456-dc21793c1685 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 11 09:59:36.316925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 388/787] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:36 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:37.327275 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:37.328781 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:37.335063 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:37.335512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:37.336314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:37.336866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:37.364660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9750dae0-b035-4403-ad79-c7639f6dac8b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041561 May 11 09:59:37.365206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 400/788] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:37 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:38.375936 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:38.376842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:38.383083 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:38.383524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:38.384328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:38.384752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:38.413672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f5ea998b-e40e-4ac1-845a-7e37ec7ca8f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041759 May 11 09:59:38.414202 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 389/789] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:38 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:39.425710 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:39.426616 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:39.432864 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:39.433305 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:39.434055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:39.434482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:39.461657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b95cbc48-c196-4def-8c7d-7df84daf0c4a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040542 May 11 09:59:39.462189 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 401/790] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:39 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:40.473694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:40.474540 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:40.480920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:40.481365 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:40.482117 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:40.482547 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:40.510801 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8e1267b4-92e3-4b27-bc21-714ed7a2e09c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041067 May 11 09:59:40.511364 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 390/791] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:40 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:41.382078 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:41.382677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:41.388862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:41.389304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:41.390120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:41.390550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:41.522367 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:41.523284 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:41.523673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:41.529487 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:41.529937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:41.531244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:41.531683 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:41.532581 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c9cca18f-0c98-479a-a02a-57567c522375 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1594 microversion: 2.1 time: 0.153931 May 11 09:59:41.543915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 402/792] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:41 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:41.570769 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c2f618ed-bf11-4f02-b090-9663c6271102 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052399 May 11 09:59:41.571520 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 391/793] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:41 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 09:59:42.581956 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:42.582788 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:42.589092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.589539 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.590313 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.590754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.621200 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cf7a404d-b2f6-466a-97c1-84b1c3cdde33 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043248 May 11 09:59:42.621769 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 403/794] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 09:59:42 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 09:59:42.678784 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:42.679298 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:42.685532 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.685986 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.686760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.687197 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.712393 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 09:59:42.790909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f6c2d07f-7740-484b-a497-0a805b8db387 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 204 len: 0 microversion: 2.1 time: 0.115611 May 11 09:59:42.791766 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 392/795] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 09:59:42 2022] DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 09:59:42.799655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:42.800292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:42.806234 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.806688 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.807463 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:42.807928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:42.934862 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:42.942392 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0ce50ad4-c55d-4c99-8a7c-97c51fc1164f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1681 microversion: 2.1 time: 0.146658 May 11 09:59:42.942970 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 404/796] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:42 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:43.447592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-7e756e1a-91c1-433c-8e23-de59705277eb req-cb6dd1a8-745b-48a8-afbd-f52516abc685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:43.458268 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7e756e1a-91c1-433c-8e23-de59705277eb req-cb6dd1a8-745b-48a8-afbd-f52516abc685 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:43.458719 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7e756e1a-91c1-433c-8e23-de59705277eb req-cb6dd1a8-745b-48a8-afbd-f52516abc685 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:43.472960 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-7e756e1a-91c1-433c-8e23-de59705277eb req-cb6dd1a8-745b-48a8-afbd-f52516abc685 service nova] Creating event network-changed:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 09:59:43.477769 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-7e756e1a-91c1-433c-8e23-de59705277eb req-cb6dd1a8-745b-48a8-afbd-f52516abc685 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039285 May 11 09:59:43.478641 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 393/797] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:43.963839 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:43.965256 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:43.974345 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:43.974965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:43.975918 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:43.976355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:44.147627 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:44.155596 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86833b61-1920-4871-aac7-a514d1c7f011 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1681 microversion: 2.1 time: 0.199720 May 11 09:59:44.157374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 405/798] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:43 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:44.397233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-8911182"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:44.397859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:44.404032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:44.404785 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:44.406404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:44.406867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:44.544706 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.network.security_group_api [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Adding security group 6e4be820-f6cb-4e80-b815-e6d5a30c0058 to port 244efff4-bcce-4eaf-989c-18c34907b28e May 11 09:59:44.988153 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-f5ed7b91-f80f-4784-9e44-f55cdfc07094 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.595914 May 11 09:59:44.989533 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 394/799] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 09:59:44 2022] POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:59:44.998949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:45.001001 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:45.012561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:45.015252 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:45.016588 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:45.017353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:45.174664 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:45.175297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:45.182698 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:45.183240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:45.184183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:45.184678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:45.329493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:45.337384 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-db35f182-1677-4128-b1d3-762010dc4729 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1681 microversion: 2.1 time: 0.167114 May 11 09:59:45.338042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 395/800] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:45 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:45.382019 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:45.390595 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-bb55835a-269c-4eab-baf8-b30050a32664 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1638 microversion: 2.1 time: 0.397126 May 11 09:59:45.391257 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 406/801] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:44 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1638 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:45.493274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-a0c838c6-63a9-4bda-97b8-d3812dd267f8 req-f9d86e27-8e13-43c0-9508-915d71bbbe62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:45.501524 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-a0c838c6-63a9-4bda-97b8-d3812dd267f8 req-f9d86e27-8e13-43c0-9508-915d71bbbe62 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:45.501964 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-a0c838c6-63a9-4bda-97b8-d3812dd267f8 req-f9d86e27-8e13-43c0-9508-915d71bbbe62 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:45.512979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-a0c838c6-63a9-4bda-97b8-d3812dd267f8 req-f9d86e27-8e13-43c0-9508-915d71bbbe62 service nova] Creating event network-changed:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 09:59:45.517787 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-a0c838c6-63a9-4bda-97b8-d3812dd267f8 req-f9d86e27-8e13-43c0-9508-915d71bbbe62 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028154 May 11 09:59:45.518382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 396/802] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:46.354466 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:46.355741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:46.366465 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-8b04e066-f897-4f12-966c-5c08fed5838f req-0e246c0a-d7d9-45f4-ab2e-be7cdc2d7346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0783e6f-7401-405a-bc36-77d27ebad679", "name": "network-vif-deleted", "tag": "5f21fe21-c736-4f08-b44d-0ccc6419ea6b"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:46.398574 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-8b04e066-f897-4f12-966c-5c08fed5838f req-0e246c0a-d7d9-45f4-ab2e-be7cdc2d7346 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:46.400218 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:46.400664 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:46.401441 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:46.401872 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:46.402333 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-8b04e066-f897-4f12-966c-5c08fed5838f req-0e246c0a-d7d9-45f4-ab2e-be7cdc2d7346 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:46.426026 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-8b04e066-f897-4f12-966c-5c08fed5838f req-0e246c0a-d7d9-45f4-ab2e-be7cdc2d7346 service nova] Creating event network-vif-deleted:5f21fe21-c736-4f08-b44d-0ccc6419ea6b for instance b0783e6f-7401-405a-bc36-77d27ebad679 on hv-cinder-83699 May 11 09:59:46.431801 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-8b04e066-f897-4f12-966c-5c08fed5838f req-0e246c0a-d7d9-45f4-ab2e-be7cdc2d7346 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070447 May 11 09:59:46.433072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 397/803] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:46.494897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:46.503964 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4f3310ea-20e2-4a10-a9c1-074732ea6b7e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 200 len: 1325 microversion: 2.1 time: 0.153243 May 11 09:59:46.504553 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 407/804] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:46 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 1325 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:47.522793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:47.523408 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:47.529549 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:47.529996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:47.530754 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:47.531220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:47.544169 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 HTTP/1.1 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 09:59:47.545751 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 09:59:47.547264 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'b0783e6f-7401-405a-bc36-77d27ebad679'} May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 09:59:47.548643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 09:59:47.550075 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 09:59:47.551503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 09:59:47.551503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d20e07f9-f5f1-4621-92b9-41af396fee23 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 404 len: 111 microversion: 2.1 time: 0.029274 May 11 09:59:47.551503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 398/805] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:47 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 09:59:47.555709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24be12d7-edcb-47fd-9bd5-ab6bc0e95f2e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '.version_select at 0x7f8bcd34baf0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:47.572685 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24be12d7-edcb-47fd-9bd5-ab6bc0e95f2e tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134438894" status: 202 len: 0 microversion: 2.1 time: 0.020697 May 11 09:59:47.573228 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 408/806] 10.222.0.44 () {58 vars in 1217 bytes} [Wed May 11 09:59:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134438894 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 09:59:48.166983 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e450e759-755c-4d6a-a2f0-fd316ad0e505 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: .version_select at 0x7f8bcd37fb80>, body: {"keypair": {"name": "tempest-keypair-1846744335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvhe2Bv041k2xb0DOFjf6unKros1hs4pZ84Ryx9tW9l4oTb3JtPLWIlRzTDMXHVtzOAX65w3SSF8kFHnZphXjLC1sMon26pPINddawh2tWNZVaOV1xZVP32IwXjGIwhxw=="}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:48.180730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-e450e759-755c-4d6a-a2f0-fd316ad0e505 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:59:48.184366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.quota [None req-e450e759-755c-4d6a-a2f0-fd316ad0e505 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'key_pairs'} {{(pid=123393) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:59:48.210032 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e450e759-755c-4d6a-a2f0-fd316ad0e505 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047040 May 11 09:59:48.210621 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 399/807] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 09:59:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:49.454684 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2138817981", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c5000ec-9218-43b8-af63-690179d5f88f"}], "security_groups": [{"name": "tempest-securitygroup--1763269059"}], "key_name": "tempest-keypair-1846744335", "user_data": "}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:49.550694 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] validate_networks() for [('2c5000ec-9218-43b8-af63-690179d5f88f', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 09:59:49.899588 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 09:59:49.900037 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 09:59:49.900509 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 09:59:49.900915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 09:59:49.901320 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 09:59:49.910603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:49.911045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:49.911874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:49.912306 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:49.928824 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 09:59:49.932647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Getting quotas for user c606d2e6c39c4cd8af4b250684a542ca and project e2f50b25d7394f49bf4912b8b7392b31. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 09:59:49.943188 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 09:59:49.945465 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 09:59:49.989296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-915f56e7-ed98-45d8-ad86-1ae43caa8301 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.539324 May 11 09:59:49.989936 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 409/808] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 09:59:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 09:59:50.000220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-14124e7a-c88a-406a-885c-1066cfd278ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:50.000836 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-14124e7a-c88a-406a-885c-1066cfd278ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:50.062405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-14124e7a-c88a-406a-885c-1066cfd278ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:50.069245 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-14124e7a-c88a-406a-885c-1066cfd278ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1242 microversion: 2.1 time: 0.073307 May 11 09:59:50.069992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 400/809] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:49 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:51.085457 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:51.086062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:51.092574 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:51.093016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:51.093774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:51.094204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:51.159225 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:51.166458 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25f5d884-184b-49b7-b359-1ede1a959659 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1300 microversion: 2.1 time: 0.085315 May 11 09:59:51.167205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 410/810] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:51 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:59:52.184551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:52.185467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:52.194248 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:52.194926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:52.195885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:52.196304 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:52.346000 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:52.354042 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-255dd7da-ab93-4731-baf2-87e1a638faea tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.173879 May 11 09:59:52.354624 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 401/811] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:52 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:52.609387 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-7678f488-4c9d-4eba-b749-b56a2c41d34a req-3fa6ddfb-b3e0-42c9-86b2-cbd5826ada83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca", "tag": "938f811e-48f9-4666-bf5b-6397318d2e66"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:52.630763 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7678f488-4c9d-4eba-b749-b56a2c41d34a req-3fa6ddfb-b3e0-42c9-86b2-cbd5826ada83 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:52.631856 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-7678f488-4c9d-4eba-b749-b56a2c41d34a req-3fa6ddfb-b3e0-42c9-86b2-cbd5826ada83 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:52.645462 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-7678f488-4c9d-4eba-b749-b56a2c41d34a req-3fa6ddfb-b3e0-42c9-86b2-cbd5826ada83 service nova] Creating event network-changed:938f811e-48f9-4666-bf5b-6397318d2e66 for instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca on hv-cinder-83699 May 11 09:59:52.651288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-7678f488-4c9d-4eba-b749-b56a2c41d34a req-3fa6ddfb-b3e0-42c9-86b2-cbd5826ada83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051033 May 11 09:59:52.652224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 411/812] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:53.372300 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:53.372907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:53.380663 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:53.381103 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:53.381860 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:53.382287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:53.504970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:53.512011 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e7f1fb3f-7bdd-426c-90f4-74974b912f34 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.143480 May 11 09:59:53.512571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 402/813] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:53 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:54.529511 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:54.530132 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:54.537717 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:54.538172 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:54.538944 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:54.539389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:54.670901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:54.678749 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8246bde5-630c-4210-b456-5b8aaaa33d91 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.153574 May 11 09:59:54.679318 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 412/814] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:54 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:55.695323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:55.695985 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:55.702290 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:55.702739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:55.703496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:55.703963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:55.834208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:55.841366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ca6e3de8-7a82-49f0-9765-5e8dedade5ce tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.149868 May 11 09:59:55.841921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 403/815] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:55 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:56.858131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:56.858775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:56.865672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:56.866124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:56.866894 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:56.867330 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:56.993380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:57.000742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fe361e52-e751-4f3c-829e-9ef5404b92e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.146391 May 11 09:59:57.001310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 413/816] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:56 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:57.043839 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-b773951e-624b-4654-90bc-c39f3d2a24d3 req-1398d31f-28c9-480e-821a-c33f32fbf04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca", "name": "network-vif-plugged", "status": "completed", "tag": "938f811e-48f9-4666-bf5b-6397318d2e66"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 09:59:57.052143 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b773951e-624b-4654-90bc-c39f3d2a24d3 req-1398d31f-28c9-480e-821a-c33f32fbf04f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:57.052585 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b773951e-624b-4654-90bc-c39f3d2a24d3 req-1398d31f-28c9-480e-821a-c33f32fbf04f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:57.063391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-b773951e-624b-4654-90bc-c39f3d2a24d3 req-1398d31f-28c9-480e-821a-c33f32fbf04f service nova] Creating event network-vif-plugged:938f811e-48f9-4666-bf5b-6397318d2e66 for instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca on hv-cinder-83699 May 11 09:59:57.068236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-b773951e-624b-4654-90bc-c39f3d2a24d3 req-1398d31f-28c9-480e-821a-c33f32fbf04f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028647 May 11 09:59:57.069051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 404/817] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 09:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 09:59:58.017191 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:58.017794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:58.024169 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:58.024616 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:58.025377 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:58.025805 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:58.151837 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:58.159928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f2e87ff5-4dce-470c-a635-c303663cd082 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1368 microversion: 2.1 time: 0.146569 May 11 09:59:58.160497 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 414/818] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:58 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 09:59:59.178551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:59.179244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:59.185955 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:59.186397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:59.187162 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:59.187591 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:59.312599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 09:59:59.320487 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fc61eb4a-adfc-4cd8-bbac-03a296312f07 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1559 microversion: 2.1 time: 0.146590 May 11 09:59:59.321076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 405/819] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 09:59:59 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 09:59:59.336402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 09:59:59.336892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 09:59:59.343080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:59.343522 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:59.344349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 09:59:59.344777 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 09:59:59.418890 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-adb7e11e-a9d9-4824-9d4b-9d11426871f2 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086193 May 11 09:59:59.419538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 415/820] 10.222.0.44 () {58 vars in 1274 bytes} [Wed May 11 09:59:59 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:00.353210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-c314dc9b-d79f-4572-9c72-fbc24aaaf74b req-f02186c3-fcf9-44db-a0c9-708084e33acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca", "tag": "938f811e-48f9-4666-bf5b-6397318d2e66"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:00.361945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-c314dc9b-d79f-4572-9c72-fbc24aaaf74b req-f02186c3-fcf9-44db-a0c9-708084e33acb service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:00.362393 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-c314dc9b-d79f-4572-9c72-fbc24aaaf74b req-f02186c3-fcf9-44db-a0c9-708084e33acb service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:00.373038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-c314dc9b-d79f-4572-9c72-fbc24aaaf74b req-f02186c3-fcf9-44db-a0c9-708084e33acb service nova] Creating event network-changed:938f811e-48f9-4666-bf5b-6397318d2e66 for instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca on hv-cinder-83699 May 11 10:00:00.378825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-c314dc9b-d79f-4572-9c72-fbc24aaaf74b req-f02186c3-fcf9-44db-a0c9-708084e33acb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029022 May 11 10:00:00.379837 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 406/821] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:08.843100 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:08.844826 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:08.851793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:08.852270 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:08.853284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:08.854144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:08.934229 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-046850a8-db7b-4d8f-8ff5-c6a4f91be513 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.096711 May 11 10:00:08.934848 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 416/822] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 10:00:08 2022] POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:00:08.944391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:08.945095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:08.951599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:08.952069 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:08.952823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:08.953250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:09.096226 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:09.104251 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4f543a6c-8cd0-4b20-9ac7-276f4c7b1389 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1749 microversion: 2.1 time: 0.165022 May 11 10:00:09.104822 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 407/823] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:08 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:10.177682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:10.178290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:10.184491 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:10.184942 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:10.185702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:10.186136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:10.334025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:10.341914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1dc0f79c-46ca-4f21-9960-5640edbcf485 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.169032 May 11 10:00:10.342480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 417/824] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:10 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:11.359267 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:11.359916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:11.366290 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:11.366737 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:11.367496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:11.367951 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:11.503739 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:11.511391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7313ce71-6bb2-4e56-b1d0-31bb6258bce4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.155956 May 11 10:00:11.511989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 408/825] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:11 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:12.529074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:12.529628 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:12.536185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:12.536624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:12.537379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:12.537806 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:12.954280 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:12.961623 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-86610f38-aa34-43e7-a7da-3da9356594f0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.436421 May 11 10:00:12.967765 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 418/826] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:12 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:13.979005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:13.979604 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:13.986510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:13.987253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:13.987976 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:13.988474 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:14.125297 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:14.133243 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-57fbfb11-8673-4715-abe7-48627156336f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.158228 May 11 10:00:14.133993 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 409/827] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:13 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:15.150578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:15.151187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:15.157533 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:15.158241 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:15.159000 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:15.159434 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:15.294766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:15.303066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b599b6d7-d8f6-4921-a316-1dad7e845fb8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.156276 May 11 10:00:15.303630 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 419/828] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:15 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:16.320667 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:16.321323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:16.327545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:16.328018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:16.328779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:16.329209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:16.472113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:16.479886 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4e991b0f-e91b-4a04-992b-e69095723102 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.162990 May 11 10:00:16.480442 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 410/829] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:16 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:17.499792 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:17.500799 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:17.508878 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:17.509326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:17.510090 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:17.510516 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:17.648572 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:17.656186 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0a3ff48-619a-49cd-9eb7-e97ac9bc3f6f tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.163105 May 11 10:00:17.656737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 420/830] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:17 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:18.673334 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:18.673944 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:18.680278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:18.680727 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:18.681490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:18.681917 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:18.816870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:18.824901 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-185bbd0e-1ad5-4a30-810e-afcf436e65b4 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.155514 May 11 10:00:18.825452 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 411/831] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:18 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:19.842304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:19.842907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:19.849268 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:19.849713 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:19.850467 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:19.850897 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:19.991438 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:19.999310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-87d6a000-9349-4ef5-a3ec-471738f5b620 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1754 microversion: 2.1 time: 0.160857 May 11 10:00:19.999905 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 421/832] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:19 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:21.016945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:21.017540 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:21.023867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:21.024316 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:21.025072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:21.025503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:21.163981 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:21.171600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-09213260-27a2-4143-bfd1-abed713b6500 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1757 microversion: 2.1 time: 0.158481 May 11 10:00:21.172190 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 412/833] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:21 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:00:32.565986 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:32.566554 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:32.572450 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:32.572898 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:32.573657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:32.574091 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:32.596666 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3b132ca7-d4a5-4237-9efd-1ff5783199ec tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/ips" status: 200 len: 149 microversion: 2.1 time: 0.034107 May 11 10:00:32.597227 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 422/834] 10.222.0.44 () {58 vars in 1247 bytes} [Wed May 11 10:00:32 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:33.894063 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79f57cd1-733d-4295-ab9c-25143c5dbc52"}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:33.895123 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:33.901471 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:33.901923 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:33.902685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:33.903119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:34.129131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4ebf1c08-c0cf-432c-b556-ae94254398ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "POST /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239320 May 11 10:00:34.129734 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 413/835] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 10:00:33 2022] POST /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:40.641034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:40.641802 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:40.648162 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:40.648617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:40.649400 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:40.649835 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:40.727298 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lazy-loading 'services' on Instance uuid 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:00:40.794948 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0184af7f-3d48-49cb-8d6d-0f446d933efc tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments/79f57cd1-733d-4295-ab9c-25143c5dbc52" status: 202 len: 0 microversion: 2.1 time: 0.157617 May 11 10:00:40.795550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 423/836] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 10:00:40 2022] DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments/79f57cd1-733d-4295-ab9c-25143c5dbc52 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:00:40.805680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:40.806734 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:40.813896 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:40.814329 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:40.815240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:40.815815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:40.848014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-81e1a810-77e6-471b-9ce7-2794647022ae tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047359 May 11 10:00:40.848697 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 414/837] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 10:00:40 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:41.860796 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:41.861855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:41.868535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:41.868981 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:41.869742 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:41.870173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:41.898118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65a52a35-ef7b-4c2c-8365-9923c95f8727 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042146 May 11 10:00:41.898670 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 424/838] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 10:00:41 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 10:00:41.953843 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:41.954337 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:41.960282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:41.960720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:41.961467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:41.961891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:41.985349 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:00:42.057620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2a48b3a6-47b3-40f3-a971-0669229fd4e9 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 204 len: 0 microversion: 2.1 time: 0.107416 May 11 10:00:42.058206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 415/839] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:41 2022] DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 11 10:00:42.067262 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:42.067903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:42.073711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:42.074161 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:42.074917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:42.075353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:42.204868 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:42.212303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cab9f240-0936-4a1b-871b-bd2becfd516a tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1682 microversion: 2.1 time: 0.149451 May 11 10:00:42.212870 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 425/840] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:42 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:43.230292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:43.230988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:43.237205 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:43.237649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:43.238433 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:43.238859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:43.367866 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:43.374992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e2c9487a-b041-4028-8c1c-531e07a78c63 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1682 microversion: 2.1 time: 0.148948 May 11 10:00:43.375771 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 416/841] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:43 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:44.392184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:44.392793 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:44.402846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:44.403297 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:44.404103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:44.404538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:44.483656 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c606d2e6c39c4cd8af4b250684a542ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2f50b25d7394f49bf4912b8b7392b31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:44.491111 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-24c4ffae-14d9-4cf4-97be-8e28ee3265ee tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 200 len: 1614 microversion: 2.1 time: 0.102728 May 11 10:00:44.491717 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 426/842] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:44 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 1614 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:00:44.560729 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-7c9d628d-afec-4c78-a519-2a127b75daa0 req-2c249a44-8c96-49ab-85d8-916dc7242e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca", "name": "network-vif-deleted", "tag": "938f811e-48f9-4666-bf5b-6397318d2e66"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:44.570185 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7c9d628d-afec-4c78-a519-2a127b75daa0 req-2c249a44-8c96-49ab-85d8-916dc7242e93 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:44.571005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-7c9d628d-afec-4c78-a519-2a127b75daa0 req-2c249a44-8c96-49ab-85d8-916dc7242e93 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:44.581887 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-7c9d628d-afec-4c78-a519-2a127b75daa0 req-2c249a44-8c96-49ab-85d8-916dc7242e93 service nova] Creating event network-vif-deleted:938f811e-48f9-4666-bf5b-6397318d2e66 for instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca on hv-cinder-83699 May 11 10:00:44.587736 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-7c9d628d-afec-4c78-a519-2a127b75daa0 req-2c249a44-8c96-49ab-85d8-916dc7242e93 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031739 May 11 10:00:44.588685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 417/843] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:45.508125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:45.509636 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:45.516891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:45.517339 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:45.518119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:45.518555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:45.531732 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca HTTP/1.1 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:45.533395 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:45.535359 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca'} May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:45.537724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:45.539061 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:45.540471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:45.540471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b8eade06-9fb1-40eb-9a5b-e1546fc236af tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 404 len: 111 microversion: 2.1 time: 0.030994 May 11 10:00:45.540471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 427/844] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:45 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:45.545878 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-904ef81f-3ea1-4422-b4c4-15b5ac322441 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '.version_select at 0x7f8bcd2e6c10>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:45.563490 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-904ef81f-3ea1-4422-b4c4-15b5ac322441 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846744335" status: 202 len: 0 microversion: 2.1 time: 0.022164 May 11 10:00:45.564184 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 418/845] 10.222.0.44 () {58 vars in 1220 bytes} [Wed May 11 10:00:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846744335 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:00:47.274503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:47.274997 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:47.281259 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:47.281709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:47.282473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:47.282907 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:47.296724 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca HTTP/1.1 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:47.298235 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.299787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca'} May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:47.300720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.302738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:47.304652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:47.304652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-861edf60-4273-48d2-87d5-5e9572609c73 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 404 len: 111 microversion: 2.1 time: 0.028929 May 11 10:00:47.304652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 428/846] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:47 2022] DELETE /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:47.308987 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:47.309714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:47.316483 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:47.316928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:47.317694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:47.318125 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:47.332793 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca HTTP/1.1 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:00:47.334407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.335963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca'} May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:47.336873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. May 11 10:00:47.338147 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:47.339351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:47.339351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-977c5eaa-f3e7-44a7-ac83-15bbd6a894c3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca" status: 404 len: 111 microversion: 2.1 time: 0.031180 May 11 10:00:47.339351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 419/847] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:47 2022] GET /compute/v2.1/servers/1bf49cc9-6cdb-4cc3-9e71-971c164ce7ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 11 10:00:48.463635 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:48.464152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:48.470405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.470799 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.471559 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.472021 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.486496 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 HTTP/1.1 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:48.488033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.489624 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'b0783e6f-7401-405a-bc36-77d27ebad679'} May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:48.490422 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.491655 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.492928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:48.492928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2b978bda-f468-4ff8-b163-8184a07cda6b tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 404 len: 111 microversion: 2.1 time: 0.029584 May 11 10:00:48.492928 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 429/848] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:48 2022] DELETE /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:48.497544 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:48.498186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: b0783e6f-7401-405a-bc36-77d27ebad679] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:48.504519 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.504967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.505724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.506156 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.677716 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 HTTP/1.1 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:00:48.679246 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.680829 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'b0783e6f-7401-405a-bc36-77d27ebad679'} May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:48.681702 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. May 11 10:00:48.682898 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.684536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance b0783e6f-7401-405a-bc36-77d27ebad679 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:48.684536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5032d10d-e274-422d-b5cd-932949a18878 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679" status: 404 len: 111 microversion: 2.1 time: 0.186892 May 11 10:00:48.684536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 420/849] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:48 2022] GET /compute/v2.1/servers/b0783e6f-7401-405a-bc36-77d27ebad679 => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:48.689215 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:48.689704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:48.696112 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.696555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.697311 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.697740 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.711264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 HTTP/1.1 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:48.712794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.714351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'a05dcd92-ad7c-43e1-8679-add6e52ecb44'} May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:48.715135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.716404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:48.717650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:48.717650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-7ad041a8-2dae-4387-a109-a4e00e60156c tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 404 len: 111 microversion: 2.1 time: 0.028762 May 11 10:00:48.717650 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 430/850] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:48 2022] DELETE /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:48.722443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:48.722992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: a05dcd92-ad7c-43e1-8679-add6e52ecb44] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:48.729221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.729672 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.730432 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:48.730865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:48.743421 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 HTTP/1.1 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:00:48.744941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.746448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'a05dcd92-ad7c-43e1-8679-add6e52ecb44'} May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:48.747179 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. May 11 10:00:48.748425 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:48.749489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance a05dcd92-ad7c-43e1-8679-add6e52ecb44 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:48.749489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-69f08878-f8c6-4247-b8d1-b04243f449db tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44" status: 404 len: 111 microversion: 2.1 time: 0.027642 May 11 10:00:48.749489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 421/851] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:48 2022] GET /compute/v2.1/servers/a05dcd92-ad7c-43e1-8679-add6e52ecb44 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:49.873367 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:49.873855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:49.880108 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:49.880552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:49.881304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:49.881732 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:49.894548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f HTTP/1.1 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:49.896600 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.898151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '4c3a8d92-c02e-49c8-b910-892dfca23b1f'} May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:49.898950 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.900205 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:49.901432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:49.901432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2ae8ed28-7acd-4f74-8d75-e32551692ee3 tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 404 len: 111 microversion: 2.1 time: 0.028353 May 11 10:00:49.901432 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 431/852] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:49 2022] DELETE /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:49.906059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:49.906669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] [instance: 4c3a8d92-c02e-49c8-b910-892dfca23b1f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:49.913915 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:49.914359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:49.915113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:49.915541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:49.928247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] HTTP exception thrown: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Request method failure captured: May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f HTTP/1.1 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4hEpxpEDu4f81n-ftSzfanZiClKBGxxIGqGD5dytg2pxWRBGzKRGP5BLdnSkA4Pf7gvUASunp_oaWICZCyrz1YN5_Nd5REyEb5dbv6VZ7Q8cKMKbA9aHN18fX7ONBkLTlNQtZ1HjPLFfrrMBvyxaaOuuTolSe6gP_Y01Bvi4w_kgNE May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:00:49.929764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e2f50b25d7394f49bf4912b8b7392b31", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e2f50b25d7394f49bf4912b8b7392b31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: e2f50b25d7394f49bf4912b8b7392b31 May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-614037984 May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: c606d2e6c39c4cd8af4b250684a542ca May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-AttachVolumeNegativeTest-614037984-project May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.931343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '4c3a8d92-c02e-49c8-b910-892dfca23b1f'} May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:49.932282 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. May 11 10:00:49.933714 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:00:49.935047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] Returning 404 to user: Instance 4c3a8d92-c02e-49c8-b910-892dfca23b1f could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:49.935047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7e93828b-9344-4714-897d-5432df71d29f tempest-AttachVolumeNegativeTest-614037984 tempest-AttachVolumeNegativeTest-614037984-project] 10.222.0.44 "GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f" status: 404 len: 111 microversion: 2.1 time: 0.028848 May 11 10:00:49.935047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 422/853] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:49 2022] GET /compute/v2.1/servers/4c3a8d92-c02e-49c8-b910-892dfca23b1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:53.546490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-8911182"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:53.547064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:53.553389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:53.553835 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:53.554603 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:53.555034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:53.680386 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.network.security_group_api [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Removing security group 6e4be820-f6cb-4e80-b815-e6d5a30c0058 from port 244efff4-bcce-4eaf-989c-18c34907b28e May 11 10:00:54.071561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a92fa219-2b07-4409-b93a-c4ab8e49d8c8 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action" status: 202 len: 0 microversion: 2.1 time: 0.529138 May 11 10:00:54.072649 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 432/854] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 10:00:53 2022] POST /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 10:00:54.085360 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-eeb4ddcc-0da5-4155-ae21-df777dbcdf44 req-86361754-d584-48f8-a743-dd1f1143ee75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:54.098045 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-eeb4ddcc-0da5-4155-ae21-df777dbcdf44 req-86361754-d584-48f8-a743-dd1f1143ee75 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:54.102510 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-eeb4ddcc-0da5-4155-ae21-df777dbcdf44 req-86361754-d584-48f8-a743-dd1f1143ee75 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:54.122475 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-eeb4ddcc-0da5-4155-ae21-df777dbcdf44 req-86361754-d584-48f8-a743-dd1f1143ee75 service nova] Creating event network-changed:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 10:00:54.127605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-eeb4ddcc-0da5-4155-ae21-df777dbcdf44 req-86361754-d584-48f8-a743-dd1f1143ee75 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046309 May 11 10:00:54.128804 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 423/855] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:55.615799 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:55.616356 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:55.622674 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:55.623124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:55.624263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:55.624699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:55.717931 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lazy-loading 'services' on Instance uuid b459e6c1-2682-412a-9a9b-3c018b657b0f {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:00:55.796776 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fa644b95-598e-4354-9f57-1f267f71dfa2 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments/4202a806-4011-4d9d-9108-d3ad5689264c" status: 202 len: 0 microversion: 2.1 time: 0.185850 May 11 10:00:55.798081 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 433/856] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 10:00:55 2022] DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments/4202a806-4011-4d9d-9108-d3ad5689264c => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:00:55.812165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:55.814232 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:55.822244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:55.822928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:55.824656 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:55.825808 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:55.862292 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-77f78a02-d89a-4583-94a9-4923b774ee5b tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059690 May 11 10:00:55.863512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 424/857] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 10:00:55 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:00:56.143199 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-c2250ee8-eff8-4771-834f-4a38c5def8ad req-31755485-b23a-426b-9672-eb23625a956d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:00:56.152040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c2250ee8-eff8-4771-834f-4a38c5def8ad req-31755485-b23a-426b-9672-eb23625a956d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:56.152563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-c2250ee8-eff8-4771-834f-4a38c5def8ad req-31755485-b23a-426b-9672-eb23625a956d service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:56.163813 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-c2250ee8-eff8-4771-834f-4a38c5def8ad req-31755485-b23a-426b-9672-eb23625a956d service nova] Creating event network-changed:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 10:00:56.169146 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-c2250ee8-eff8-4771-834f-4a38c5def8ad req-31755485-b23a-426b-9672-eb23625a956d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029838 May 11 10:00:56.170131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 434/858] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 10:00:56.874761 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:56.875807 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:56.882536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:56.882992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:56.883797 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:56.884233 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:56.913960 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-28a3b554-e558-4328-ba4a-09057257095c tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043218 May 11 10:00:56.914509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 425/859] 10.222.0.44 () {58 vars in 1301 bytes} [Wed May 11 10:00:56 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 11 10:00:56.925477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:56.926058 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:56.932859 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:56.933310 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:56.934077 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:56.934512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:57.008409 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] HTTP exception thrown: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f is not attached to volume 4202a806-4011-4d9d-9108-d3ad5689264c May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Request method failure captured: May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments/4202a806-4011-4d9d-9108-d3ad5689264c HTTP/1.1 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4jiz6Fnws0mWldT03zZYev1yEGHU6chtewyS65o8qu2UiIJolMK8FJFOYO-C5lIfWzFXT0ngMjRto3Pi_T65du9Jf6siPNkjAX4B7uy6IWt-S3FTOiUrhzJNwsYKsR91B78gkVbjM7biyu9vo_A6hBb2rHuVxzmt7GYRokgeGrgCf4 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 5dbe901a83894751a9857a411986025a May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-TestMinimumBasicScenario-1087043480 May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:00:57.019660 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5dbe901a83894751a9857a411986025a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5dbe901a83894751a9857a411986025a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5dbe901a83894751a9857a411986025a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5dbe901a83894751a9857a411986025a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-TestMinimumBasicScenario-1087043480 May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 5dbe901a83894751a9857a411986025a May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1087043480 May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-TestMinimumBasicScenario-1087043480-project May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: d1c854066d8a4cb99f7f5b1647561e53 May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-TestMinimumBasicScenario-1087043480-project May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:00:57.021153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f is not attached to volume 4202a806-4011-4d9d-9108-d3ad5689264c May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'server_id': 'b459e6c1-2682-412a-9a9b-3c018b657b0f', 'id': '4202a806-4011-4d9d-9108-d3ad5689264c'} May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4202a806-4011-4d9d-9108-d3ad5689264c. May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:00:57.021903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f is not attached to volume 4202a806-4011-4d9d-9108-d3ad5689264c May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f is not attached to volume 4202a806-4011-4d9d-9108-d3ad5689264c May 11 10:00:57.023380 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:00:57.024589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Returning 404 to user: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f is not attached to volume 4202a806-4011-4d9d-9108-d3ad5689264c {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:00:57.024589 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-19766171-c4c1-424f-91e0-592947a0ceb6 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments/4202a806-4011-4d9d-9108-d3ad5689264c" status: 404 len: 154 microversion: 2.1 time: 0.103888 May 11 10:00:57.025794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 435/860] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 10:00:56 2022] DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f/os-volume_attachments/4202a806-4011-4d9d-9108-d3ad5689264c => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:00:58.155610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:58.156176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:58.162729 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:58.163174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:58.163963 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:58.164415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:58.188129 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:00:58.264186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d69f60cd-3420-4d75-9dcc-ab8fc421aa66 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 204 len: 0 microversion: 2.1 time: 0.112215 May 11 10:00:58.264885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 426/861] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:00:58 2022] DELETE /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:00:58.273204 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:58.273844 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:58.280101 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:58.280546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:58.281322 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:58.281738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:58.414303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:58.421681 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ecb6f53d-6803-43d3-986d-f2edff1f574d tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1554 microversion: 2.1 time: 0.152386 May 11 10:00:58.422248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 436/862] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:58 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:00:59.440051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:00:59.440748 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:00:59.447586 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:59.448062 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:59.448823 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:00:59.449255 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:00:59.579929 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:00:59.587511 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-c3cc2db0-7e55-4527-933a-d779645088c0 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1554 microversion: 2.1 time: 0.151770 May 11 10:00:59.588119 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 427/863] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:00:59 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:00.452450 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-3ba5a94e-8d7f-45da-b928-a378e633619c req-c6f3ab4d-3ab6-48cd-9af0-b744b19d9bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b459e6c1-2682-412a-9a9b-3c018b657b0f", "name": "network-vif-deleted", "tag": "244efff4-bcce-4eaf-989c-18c34907b28e"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:00.461498 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3ba5a94e-8d7f-45da-b928-a378e633619c req-c6f3ab4d-3ab6-48cd-9af0-b744b19d9bd8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:00.461934 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-3ba5a94e-8d7f-45da-b928-a378e633619c req-c6f3ab4d-3ab6-48cd-9af0-b744b19d9bd8 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:00.473292 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-3ba5a94e-8d7f-45da-b928-a378e633619c req-c6f3ab4d-3ab6-48cd-9af0-b744b19d9bd8 service nova] Creating event network-vif-deleted:244efff4-bcce-4eaf-989c-18c34907b28e for instance b459e6c1-2682-412a-9a9b-3c018b657b0f on hv-cinder-83699 May 11 10:01:00.478662 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-3ba5a94e-8d7f-45da-b928-a378e633619c req-c6f3ab4d-3ab6-48cd-9af0-b744b19d9bd8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 May 11 10:01:00.479317 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 437/864] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 10:01:00.605001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:00.605616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:00.612164 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:00.612637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:00.613434 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:00.613991 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:00.645029 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:00.645557 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:00.646012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lazy-loading 'fault' on Instance uuid b459e6c1-2682-412a-9a9b-3c018b657b0f {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:01:00.690459 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1c854066d8a4cb99f7f5b1647561e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe901a83894751a9857a411986025a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:00.698505 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1c474232-bb2d-478f-9921-fded68a30546 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 200 len: 1349 microversion: 2.1 time: 0.097416 May 11 10:01:00.699158 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 428/865] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:00 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 1349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:01.717164 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:01.717860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] [instance: b459e6c1-2682-412a-9a9b-3c018b657b0f] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:01.724223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:01.724702 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:01.725471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:01.726533 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:01.742336 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] HTTP exception thrown: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Request method failure captured: May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f HTTP/1.1 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4jiz6Fnws0mWldT03zZYev1yEGHU6chtewyS65o8qu2UiIJolMK8FJFOYO-C5lIfWzFXT0ngMjRto3Pi_T65du9Jf6siPNkjAX4B7uy6IWt-S3FTOiUrhzJNwsYKsR91B78gkVbjM7biyu9vo_A6hBb2rHuVxzmt7GYRokgeGrgCf4 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 5dbe901a83894751a9857a411986025a May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-TestMinimumBasicScenario-1087043480 May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:01:01.744016 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5dbe901a83894751a9857a411986025a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5dbe901a83894751a9857a411986025a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5dbe901a83894751a9857a411986025a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5dbe901a83894751a9857a411986025a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-TestMinimumBasicScenario-1087043480 May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 5dbe901a83894751a9857a411986025a May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1087043480 May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-TestMinimumBasicScenario-1087043480-project May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: d1c854066d8a4cb99f7f5b1647561e53 May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-TestMinimumBasicScenario-1087043480-project May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. May 11 10:01:01.745453 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'b459e6c1-2682-412a-9a9b-3c018b657b0f'} May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:01:01.746240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. May 11 10:01:01.747780 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:01:01.749754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Returning 404 to user: Instance b459e6c1-2682-412a-9a9b-3c018b657b0f could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:01:01.749754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a8847bcc-3fdd-414b-930d-078da39ca877 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f" status: 404 len: 111 microversion: 2.1 time: 0.033033 May 11 10:01:01.749754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 438/866] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:01 2022] GET /compute/v2.1/servers/b459e6c1-2682-412a-9a9b-3c018b657b0f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:01:01.754587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3a087926-1fff-4e46-9ed8-6fdc6e870f01 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] Calling method '.version_select at 0x7f8bcd396a60>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:01.773431 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3a087926-1fff-4e46-9ed8-6fdc6e870f01 tempest-TestMinimumBasicScenario-1087043480 tempest-TestMinimumBasicScenario-1087043480-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1032337737" status: 202 len: 0 microversion: 2.1 time: 0.021961 May 11 10:01:01.773996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 429/867] 10.222.0.44 () {58 vars in 1271 bytes} [Wed May 11 10:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1032337737 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 11 10:01:20.680699 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-fff5d338-ab2c-4cc3-a8ed-2cc17886ac5b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Action: 'create', calling method: .version_select at 0x7f8bcd3019d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1603837308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZ9lyaLQ5lr5EYxXsNGaucga1Kaoz6Puipnh2oJ0Us/Rci3mK2j7rpjx1EtIA//BhEk3wHPgUOJIA4mTr2osCtxVoRL9CrH+NWWXvZ1vAEzHmIKdAyGy1Ij6dw/W3ekDA=="}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:20.695190 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-fff5d338-ab2c-4cc3-a8ed-2cc17886ac5b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:01:20.698989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-fff5d338-ab2c-4cc3-a8ed-2cc17886ac5b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for user e457b7d59444405c89fb15e989245889 and project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'key_pairs'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:01:20.722152 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-fff5d338-ab2c-4cc3-a8ed-2cc17886ac5b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.207625 May 11 10:01:20.722845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 439/868] 10.222.0.44 () {60 vars in 1158 bytes} [Wed May 11 10:01:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:23.281001 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:01:23.281530 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:01:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:01:25.974380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:25.975187 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:25.982215 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:25.982802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:25.983568 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:25.984035 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:26.010536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lazy-loading 'flavor' on Instance uuid e10de351-bb53-4c50-92e8-25d6c8e805bd {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:01:26.090725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d7c0e0aa-5f45-4aad-b33d-dc7e5d1a2086 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "POST /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd/action" status: 202 len: 0 microversion: 2.1 time: 0.120807 May 11 10:01:26.091662 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 430/869] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 10:01:25 2022] POST /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:01:26.099849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:26.101103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:26.108703 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:26.109263 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:26.115716 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:26.116215 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:26.351575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:26.359601 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-16228244-2f0b-4142-974c-9ca0a071f968 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.263656 May 11 10:01:26.360206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 440/870] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:26 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:27.378571 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:27.379224 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:27.386599 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:27.387250 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:27.388183 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:27.388727 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:27.582979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:27.591862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9238b681-0240-4f4f-99b4-d2f602f15c95 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.218074 May 11 10:01:27.592434 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 431/871] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:27 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:28.609105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:28.609714 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:28.616141 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:28.616590 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:28.617351 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:28.617785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:28.751579 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:28.760059 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2be48656-5861-4129-8899-6874628945c9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.154149 May 11 10:01:28.760869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 441/872] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:28 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:29.777401 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:29.778188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:29.785350 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:29.785802 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:29.786850 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:29.787285 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:29.918244 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:29.926747 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-25a11780-6a3b-421f-bb0e-a3c72bca7dfd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.154068 May 11 10:01:29.927315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 432/873] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:29 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:30.943790 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:30.944337 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:30.950076 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:30.950534 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:30.951300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:30.951760 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:31.085738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:31.094728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d1d7daad-4ad9-4ee7-b293-451cf313a327 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.155027 May 11 10:01:31.095366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 442/874] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:30 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:32.112789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:32.113409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:32.119768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:32.120223 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:32.120990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:32.121429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:32.253157 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:32.261059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-83e84235-f44e-400b-997c-1f6d2ef42668 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.152131 May 11 10:01:32.261617 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 433/875] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:32 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:33.277394 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:33.278099 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:33.284425 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:33.284874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:33.285620 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:33.286050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:33.415701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:33.422998 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cbff32b0-e0b7-4770-ac29-3260eeefa92d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.149487 May 11 10:01:33.423571 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 443/876] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:33 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:34.441579 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:34.442190 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:34.448613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:34.449053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:34.449805 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:34.450229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:34.580469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:34.588235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-80155a6d-a02d-4937-89b0-ba1a5ed654ae tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.151503 May 11 10:01:34.588789 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 434/877] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:34 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:35.607983 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:35.608606 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:35.614860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:35.615299 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:35.616156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:35.616582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:35.752211 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:35.759601 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ef99b02b-b3f9-42bc-b9b8-1a363023f904 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.155489 May 11 10:01:35.760201 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 444/878] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:35 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:36.776610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:36.777239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:36.784842 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:36.785514 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:36.786480 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:36.787342 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:36.918745 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:36.926343 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-4b7afe12-dbe4-480b-897c-ac587e354c85 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.153498 May 11 10:01:36.926913 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 435/879] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:36 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:37.087627 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-585424837", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1603837308", "security_groups": [{"name": "tempest-secgroup-smoke-1774664988"}], "block_device_mapping_v2": [{"uuid": "56bf24c8-9419-4e49-a6e7-19dbbaa81079", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c44cd1a1-c51a-4594-a7a3-35c53d0c159d"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:37.197072 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] validate_networks() for [('c44cd1a1-c51a-4594-a7a3-35c53d0c159d', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 10:01:37.564412 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 10:01:37.564874 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 10:01:37.565370 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 10:01:37.565774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 10:01:37.566182 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 10:01:37.575889 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:37.576336 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:37.577136 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:37.577575 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:37.594371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:01:37.598789 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for user e457b7d59444405c89fb15e989245889 and project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:01:37.655853 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 10:01:37.658020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56bf24c8-9419-4e49-a6e7-19dbbaa81079',volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 10:01:37.782592 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-30540ea5-e205-45b2-850f-f2b86348ddab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698722 May 11 10:01:37.783241 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 445/880] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 10:01:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 10:01:37.793600 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-59710d5a-4d15-4f89-95c7-eea387e17573 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:37.794389 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-59710d5a-4d15-4f89-95c7-eea387e17573 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:37.849633 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-59710d5a-4d15-4f89-95c7-eea387e17573 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:37.859078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-59710d5a-4d15-4f89-95c7-eea387e17573 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1094 microversion: 2.1 time: 0.069453 May 11 10:01:37.859649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 436/881] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:37 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:37.943673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:37.944308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:37.951279 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:37.951791 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:37.952563 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:37.952994 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:38.109775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:38.117379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-efac42b6-7aa6-4910-ba15-64607e1ee715 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.177595 May 11 10:01:38.123838 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 446/882] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:37 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:38.876416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:38.877029 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:38.884656 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:38.885729 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:38.886649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:38.887242 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:38.954592 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:38.961864 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b491405f-50cf-4a4d-b9e5-217d310f35c9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1210 microversion: 2.1 time: 0.089918 May 11 10:01:38.962418 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 437/883] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:38 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:39.134428 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:39.135038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:39.142118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.142555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.143326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.143800 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.383410 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:39.391185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c40c8f62-1fc3-4865-bb18-86cfe3019db9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1570 microversion: 2.1 time: 0.260498 May 11 10:01:39.391869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 447/884] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:39 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1570 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:39.408934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:39.409616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:39.415943 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.416384 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.417247 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.417684 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.531402 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-e04b3453-ab4d-4571-b489-fb323648ad3c tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "POST /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd/action" status: 202 len: 0 microversion: 2.1 time: 0.126656 May 11 10:01:39.532099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 438/885] 10.222.0.44 () {60 vars in 1277 bytes} [Wed May 11 10:01:39 2022] POST /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:01:39.541116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:39.542887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:39.550562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.551319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.552529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:39.553243 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:39.813274 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:39.822518 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b5cd9a5a-88f4-4ffc-b210-a3d4b58a05f9 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1518 microversion: 2.1 time: 0.286172 May 11 10:01:39.824248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 448/886] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:39 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1518 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:01:39.987274 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:39.987945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:40.001962 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:40.001962 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:40.002405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:40.003003 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:40.203796 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:40.213113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-9bd5fe07-665f-4730-9e59-c70e1ca041bb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.236477 May 11 10:01:40.213688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 439/887] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:39 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:40.826759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-329413d7-a3bb-4858-b23d-51745857e661 req-d85f0070-0285-4602-bf94-cca14af57ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b23ffe8-185c-40fa-a29e-ddca19f85158", "tag": "50fd9419-effb-444f-aeda-d1eca1fde3e6"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:40.843814 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:40.844748 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:40.852102 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-329413d7-a3bb-4858-b23d-51745857e661 req-d85f0070-0285-4602-bf94-cca14af57ff1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:40.852540 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-329413d7-a3bb-4858-b23d-51745857e661 req-d85f0070-0285-4602-bf94-cca14af57ff1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:40.857145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:40.857597 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:40.858370 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:40.858877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:40.885551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-329413d7-a3bb-4858-b23d-51745857e661 req-d85f0070-0285-4602-bf94-cca14af57ff1 service nova] Creating event network-changed:50fd9419-effb-444f-aeda-d1eca1fde3e6 for instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 on hv-cinder-83699 May 11 10:01:40.893658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-329413d7-a3bb-4858-b23d-51745857e661 req-d85f0070-0285-4602-bf94-cca14af57ff1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070268 May 11 10:01:40.894578 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 449/888] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:41.066417 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:41.075881 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3ecb52fb-2ec8-4844-93a1-526d3fe77b74 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1520 microversion: 2.1 time: 0.236708 May 11 10:01:41.077115 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 440/889] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:40 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:41.230854 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:41.231607 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:41.237814 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:41.238261 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:41.239024 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:41.239460 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:41.423201 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:41.431550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-a7541eeb-00e6-4403-81b0-8ce62ee6e9a3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.204811 May 11 10:01:41.432151 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 450/890] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:41 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:41.569499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-512b88e8-bf27-4f3b-b95a-3eb5b63cd4cd req-b53686ce-a8fc-416b-8ffb-01ac554305c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "name": "network-vif-unplugged", "status": "completed", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:41.578872 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-512b88e8-bf27-4f3b-b95a-3eb5b63cd4cd req-b53686ce-a8fc-416b-8ffb-01ac554305c5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:41.579340 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-512b88e8-bf27-4f3b-b95a-3eb5b63cd4cd req-b53686ce-a8fc-416b-8ffb-01ac554305c5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:41.592429 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-512b88e8-bf27-4f3b-b95a-3eb5b63cd4cd req-b53686ce-a8fc-416b-8ffb-01ac554305c5 service nova] Creating event network-vif-unplugged:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 10:01:41.597957 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-512b88e8-bf27-4f3b-b95a-3eb5b63cd4cd req-b53686ce-a8fc-416b-8ffb-01ac554305c5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033739 May 11 10:01:41.598912 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 441/891] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:42.095013 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:42.097542 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:42.105053 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:42.105697 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:42.109447 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:42.109903 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:42.421290 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:42.434677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4dfea63b-3522-49a7-8730-301a5f07bc9a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.342772 May 11 10:01:42.434677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 451/892] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:42 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:42.450014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:42.451572 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:42.457941 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:42.458518 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:42.459359 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:42.459900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:42.599767 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:42.607671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2b4ee510-c2a3-4300-87a1-6c2c300607c8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.162238 May 11 10:01:42.608324 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 442/893] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:42 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:43.453046 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:43.453659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:43.460256 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:43.460706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:43.461482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:43.461917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:43.591894 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:43.599304 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-62e46d76-2eee-404f-ae07-feddbbc6df3b tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.150177 May 11 10:01:43.599899 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 452/894] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:43 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:43.624735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:43.625347 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:43.631708 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:43.632160 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:43.633110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:43.633541 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:43.767407 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:43.774687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ba322def-ecca-41ab-8734-d36dd83f8763 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.153743 May 11 10:01:43.775257 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 443/895] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:43 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:44.618461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:44.618984 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:44.625308 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:44.625757 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:44.626526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:44.626957 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:44.760332 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:44.768355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-41417dcc-81d6-4736-97ec-8b630471c7ef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.153769 May 11 10:01:44.768925 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 453/896] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:44 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:44.791920 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:44.792546 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:44.798990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:44.799442 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:44.800240 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:44.800735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:44.930938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:44.938605 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ca925273-fcb7-4c67-9d94-90e0d9008ba9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.150560 May 11 10:01:44.940596 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 444/897] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:44 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:45.785633 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:45.786245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:45.792912 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:45.793371 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:45.794143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:45.794614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:45.919794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:45.927054 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3436aa7a-c327-49a4-a93b-96d9bb9e3039 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.145298 May 11 10:01:45.927617 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 454/898] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:45 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:45.954832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:45.955444 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:45.961763 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:45.962207 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:45.962961 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:45.963391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:46.087730 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:46.095014 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d9880aa4-bac1-47e2-b83a-2744b69cada4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.144692 May 11 10:01:46.095572 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 445/899] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:45 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:46.944171 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:46.944785 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:46.951582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:46.952062 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:46.952831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:46.953271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:47.080680 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:47.087932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8b0cbeb8-9c9e-4cab-9abb-755e97346d9d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.147423 May 11 10:01:47.088437 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 455/900] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:46 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:47.111482 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:47.112149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:47.118336 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:47.118782 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:47.119537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:47.119991 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:47.250142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:47.257548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-84d3ab48-a384-4407-9ac8-5b5dda4bf8fa tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.149948 May 11 10:01:47.258221 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 446/901] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:47 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:48.105129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:48.105729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:48.112220 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:48.112674 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:48.113480 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:48.113917 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:48.239801 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:48.247120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4bbb4503-d897-406a-8b9c-f8efb34960dd tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.145818 May 11 10:01:48.248227 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 456/902] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:48 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:48.274152 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:48.274821 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:48.281456 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:48.281916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:48.282689 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:48.283131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:48.410671 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:48.418570 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-da749edd-3032-40b7-ada1-dc7e3774b0d8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.148145 May 11 10:01:48.419158 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 447/903] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:48 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:49.264280 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:49.265512 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:49.271953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:49.272403 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:49.273167 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:49.273602 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:49.400435 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:49.407663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f14f5358-e5d6-4dd2-bf5a-f329e809ea75 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1576 microversion: 2.1 time: 0.147213 May 11 10:01:49.408250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 457/904] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:49 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1576 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:49.435888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:49.436546 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:49.443236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:49.443680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:49.444458 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:49.444883 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:49.579311 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:49.586603 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-6e79d66b-0e18-4d30-bef7-8922c8a6a533 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.154531 May 11 10:01:49.587170 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 448/905] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:49 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:50.424766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:50.425390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:50.431623 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:50.432168 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:50.432940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:50.433374 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:50.571876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:50.581100 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cfaaad89-0b02-4348-a4dc-22d84bd99309 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1563 microversion: 2.1 time: 0.159265 May 11 10:01:50.583145 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 458/906] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:50 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:50.603486 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:50.604067 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:50.610261 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:50.610707 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:50.611531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:50.611978 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:50.746896 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:50.754613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dc65d48a-95b2-442b-8908-cee32e4cea0c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.155021 May 11 10:01:50.755174 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 449/907] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:50 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:51.692772 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-24b08945-17da-463a-a377-5742b2490cbb req-423c9f00-9242-4890-89af-30641fd5b7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "name": "network-vif-plugged", "status": "completed", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:51.701046 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-24b08945-17da-463a-a377-5742b2490cbb req-423c9f00-9242-4890-89af-30641fd5b7a1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:51.701482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-24b08945-17da-463a-a377-5742b2490cbb req-423c9f00-9242-4890-89af-30641fd5b7a1 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:51.712287 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-24b08945-17da-463a-a377-5742b2490cbb req-423c9f00-9242-4890-89af-30641fd5b7a1 service nova] Creating event network-vif-plugged:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 10:01:51.717223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-24b08945-17da-463a-a377-5742b2490cbb req-423c9f00-9242-4890-89af-30641fd5b7a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028140 May 11 10:01:51.718652 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 459/908] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:51.772093 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:51.772888 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:51.779188 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:51.779643 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:51.780440 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:51.781426 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:51.920934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:51.928209 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d24cdff9-96e6-4d19-8b1a-518527794fa8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.160461 May 11 10:01:51.928777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 450/909] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:51 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:52.946855 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:52.947452 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:52.956124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:52.956555 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:52.957472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:52.957900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:53.090070 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:53.098066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e9747f1b-8787-4e12-b312-a4a4ce48cdee tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.156520 May 11 10:01:53.098632 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 460/910] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:52 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:53.738372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-c6bb1db3-dc1b-4a44-bca3-9282e365b8d8 req-aff8ef40-2fff-4fe6-81b8-fd8b423faf09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b23ffe8-185c-40fa-a29e-ddca19f85158", "name": "network-vif-plugged", "status": "completed", "tag": "50fd9419-effb-444f-aeda-d1eca1fde3e6"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:53.746583 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-c6bb1db3-dc1b-4a44-bca3-9282e365b8d8 req-aff8ef40-2fff-4fe6-81b8-fd8b423faf09 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:53.747022 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-c6bb1db3-dc1b-4a44-bca3-9282e365b8d8 req-aff8ef40-2fff-4fe6-81b8-fd8b423faf09 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:53.757414 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-c6bb1db3-dc1b-4a44-bca3-9282e365b8d8 req-aff8ef40-2fff-4fe6-81b8-fd8b423faf09 service nova] Creating event network-vif-plugged:50fd9419-effb-444f-aeda-d1eca1fde3e6 for instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 on hv-cinder-83699 May 11 10:01:53.762194 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-c6bb1db3-dc1b-4a44-bca3-9282e365b8d8 req-aff8ef40-2fff-4fe6-81b8-fd8b423faf09 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028113 May 11 10:01:53.762743 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 451/911] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:54.114992 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:54.115593 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:54.121876 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:54.122326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:54.123085 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:54.123519 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:54.254445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:54.261734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-42e0ff7b-c8b6-4d95-864c-e7eb665e8444 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1266 microversion: 2.1 time: 0.150625 May 11 10:01:54.262296 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 461/912] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:54 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:55.278611 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:55.279313 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:55.286907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:55.287356 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:55.288406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:55.288838 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:55.435374 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:55.443466 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-731aa538-8282-4596-9673-aaba99f1eadb tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1451 microversion: 2.1 time: 0.168869 May 11 10:01:55.444394 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 452/913] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:55 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:01:55.459234 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:55.461030 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:55.468045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:55.469074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:55.469915 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:55.470418 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:55.603615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:55.611417 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-dc85e614-a7b8-4426-803e-74a1922467cc tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1451 microversion: 2.1 time: 0.155946 May 11 10:01:55.612127 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 462/914] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:55 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:01:57.690453 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-b45ece26-a962-48e6-ae67-0062e681cd9a req-e51933df-5ae5-4068-9f5e-c863a4c46521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b23ffe8-185c-40fa-a29e-ddca19f85158", "tag": "50fd9419-effb-444f-aeda-d1eca1fde3e6"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:57.698710 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b45ece26-a962-48e6-ae67-0062e681cd9a req-e51933df-5ae5-4068-9f5e-c863a4c46521 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:57.699154 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b45ece26-a962-48e6-ae67-0062e681cd9a req-e51933df-5ae5-4068-9f5e-c863a4c46521 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:57.710387 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-b45ece26-a962-48e6-ae67-0062e681cd9a req-e51933df-5ae5-4068-9f5e-c863a4c46521 service nova] Creating event network-changed:50fd9419-effb-444f-aeda-d1eca1fde3e6 for instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 on hv-cinder-83699 May 11 10:01:57.715956 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-b45ece26-a962-48e6-ae67-0062e681cd9a req-e51933df-5ae5-4068-9f5e-c863a4c46521 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028998 May 11 10:01:57.716669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 453/915] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:01:58.555729 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-796878287", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "networks": [{"uuid": "7fe5885e-0a49-4190-b49b-48f87998205a"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:01:58.608307 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] validate_networks() for [('7fe5885e-0a49-4190-b49b-48f87998205a', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 10:01:58.964849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 10:01:58.965271 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 10:01:58.965738 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 10:01:58.966144 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 10:01:58.966550 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 10:01:58.975590 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:58.976133 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:58.976933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:01:58.977367 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:01:58.993893 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Getting quotas for project 6242ea8efd81485693f00c4cd1edc5b4. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:01:58.997690 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Getting quotas for user acfd655c27b54d0cb6bc8942536f46dc and project 6242ea8efd81485693f00c4cd1edc5b4. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:01:59.008064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 10:01:59.010248 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 10:01:59.053926 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-345cb65d-4b57-45ca-a9f0-b546d968dbd6 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502044 May 11 10:01:59.054573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 463/916] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 10:01:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 10:01:59.065503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-79f1abd1-9b3a-40b4-822f-24fa17c1d248 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:01:59.066206 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-79f1abd1-9b3a-40b4-822f-24fa17c1d248 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:01:59.118999 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-79f1abd1-9b3a-40b4-822f-24fa17c1d248 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:01:59.125587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-79f1abd1-9b3a-40b4-822f-24fa17c1d248 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1218 microversion: 2.1 time: 0.064729 May 11 10:01:59.126234 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 454/917] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:01:59 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:00.142639 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:00.143249 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:00.149815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:00.150264 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:00.151034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:00.151477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:00.216733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:00.224901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-05779d03-20e0-4b35-8946-0e51908ac2fe tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1276 microversion: 2.1 time: 0.086515 May 11 10:02:00.225479 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 464/918] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:00 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:02:01.241916 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:01.242532 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:01.249622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:01.250006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:01.250778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:01.251900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:01.271032 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-eadca269-6a5c-45d1-b976-279d18b0e7ad req-d43d7a7c-2980-4418-bacd-9124db4e4426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b", "tag": "f9431e24-7b8e-44ca-98bc-9b3523052435"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:02:01.284439 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-eadca269-6a5c-45d1-b976-279d18b0e7ad req-d43d7a7c-2980-4418-bacd-9124db4e4426 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:01.284884 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-eadca269-6a5c-45d1-b976-279d18b0e7ad req-d43d7a7c-2980-4418-bacd-9124db4e4426 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:01.306054 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-eadca269-6a5c-45d1-b976-279d18b0e7ad req-d43d7a7c-2980-4418-bacd-9124db4e4426 service nova] Creating event network-changed:f9431e24-7b8e-44ca-98bc-9b3523052435 for instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b on hv-cinder-83699 May 11 10:02:01.312089 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-eadca269-6a5c-45d1-b976-279d18b0e7ad req-d43d7a7c-2980-4418-bacd-9124db4e4426 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046848 May 11 10:02:01.312938 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 465/919] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:02:01.382107 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:01.389348 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-841deb06-720b-48ba-a203-9d3d8656b8f7 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1318 microversion: 2.1 time: 0.151298 May 11 10:02:01.389919 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 455/920] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:01 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:02.410458 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:02.411598 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:02.419800 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:02.420311 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:02.421375 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:02.421821 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:02.583050 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:02.594659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-e0bae7f7-8017-4e23-84e8-fdfd2b8d75bf tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1318 microversion: 2.1 time: 0.192028 May 11 10:02:02.596326 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 466/921] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:02 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:03.612861 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:03.613501 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:03.619741 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:03.620399 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:03.620938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:03.621363 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:03.749258 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:03.756613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-b5e4239a-cebc-42a3-88a8-21ed7e7b2ebc tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1318 microversion: 2.1 time: 0.148222 May 11 10:02:03.757269 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 456/922] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:03 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:04.773224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:04.773840 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:04.780208 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:04.780661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:04.781429 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:04.781866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:04.908947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:04.916503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c0f7fc0f-a741-4c4e-a03e-0c175f3f9974 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1318 microversion: 2.1 time: 0.147228 May 11 10:02:04.917064 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 467/923] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:04 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:05.764763 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-80d0e5f3-2df5-4ed8-a8ad-091c5380d274 req-f968b964-d00c-4128-9fa2-e230ae634d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b", "name": "network-vif-plugged", "status": "completed", "tag": "f9431e24-7b8e-44ca-98bc-9b3523052435"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:02:05.773055 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-80d0e5f3-2df5-4ed8-a8ad-091c5380d274 req-f968b964-d00c-4128-9fa2-e230ae634d52 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:05.773499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-80d0e5f3-2df5-4ed8-a8ad-091c5380d274 req-f968b964-d00c-4128-9fa2-e230ae634d52 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:05.786810 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-80d0e5f3-2df5-4ed8-a8ad-091c5380d274 req-f968b964-d00c-4128-9fa2-e230ae634d52 service nova] Creating event network-vif-plugged:f9431e24-7b8e-44ca-98bc-9b3523052435 for instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b on hv-cinder-83699 May 11 10:02:05.792113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-80d0e5f3-2df5-4ed8-a8ad-091c5380d274 req-f968b964-d00c-4128-9fa2-e230ae634d52 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031085 May 11 10:02:05.792694 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 457/924] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:02:05.933506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:05.934239 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:05.940783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:05.941298 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:05.942137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:05.942637 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:06.097080 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:06.104237 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b7430a61-f78e-4bef-84e3-27b7e429716b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1318 microversion: 2.1 time: 0.174623 May 11 10:02:06.104795 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 468/925] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:05 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:07.123108 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:07.124535 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:07.131573 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:07.132040 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:07.132799 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:07.133228 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:07.257488 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:07.264765 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d07a413c-6a76-4736-8d27-f0555f895928 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1508 microversion: 2.1 time: 0.147130 May 11 10:02:07.265325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 458/926] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:07 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:22.337730 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54537152-a942-4ed8-9139-1c40bca78916", "device": "/dev/sdb"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:02:22.339273 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:22.345497 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:22.345947 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:22.346709 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:22.347143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:22.574250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-136ac148-7822-4eb4-850e-a890636d202b tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "POST /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240273 May 11 10:02:22.574972 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 469/927] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 10:02:22 2022] POST /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:02:45.094934 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:45.095443 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:45.101445 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:45.101899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:45.102661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:45.103094 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:45.180846 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lazy-loading 'services' on Instance uuid 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:02:45.250097 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5168a56d-427a-459d-bad4-9a15d61c7ffb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b/os-volume_attachments/54537152-a942-4ed8-9139-1c40bca78916" status: 202 len: 0 microversion: 2.1 time: 0.158916 May 11 10:02:45.250877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 459/928] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 10:02:45 2022] DELETE /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b/os-volume_attachments/54537152-a942-4ed8-9139-1c40bca78916 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:02:46.360143 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:46.360755 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:46.366869 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:46.367312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:46.368104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:46.368535 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:46.392360 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:02:46.464833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5da6e888-f5a3-4429-8955-95495e303ee1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "DELETE /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 204 len: 0 microversion: 2.1 time: 0.109067 May 11 10:02:46.465443 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 470/929] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:02:46 2022] DELETE /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:02:46.474996 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:46.476139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:46.482612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:46.483056 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:46.483845 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:46.484304 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:46.609458 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:46.616820 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-09eb1eaf-c588-42c0-b228-9d0d38da1266 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1514 microversion: 2.1 time: 0.146853 May 11 10:02:46.617382 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 460/930] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:46 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:02:47.634524 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:47.635128 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:47.641487 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:47.641933 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:47.642690 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:47.643123 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:47.772587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:47.780005 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-eaa4ec26-67e2-44d2-8358-6160b6125f74 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1514 microversion: 2.1 time: 0.149776 May 11 10:02:47.780568 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 471/931] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:47 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:02:48.570053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-239ffd8b-ee46-4000-851a-404c11dd037b req-f5cae0c1-78f3-41a9-a1cf-6a50beb37f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b", "name": "network-vif-deleted", "tag": "f9431e24-7b8e-44ca-98bc-9b3523052435"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:02:48.577892 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-239ffd8b-ee46-4000-851a-404c11dd037b req-f5cae0c1-78f3-41a9-a1cf-6a50beb37f6b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:48.578328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-239ffd8b-ee46-4000-851a-404c11dd037b req-f5cae0c1-78f3-41a9-a1cf-6a50beb37f6b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:48.589143 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-239ffd8b-ee46-4000-851a-404c11dd037b req-f5cae0c1-78f3-41a9-a1cf-6a50beb37f6b service nova] Creating event network-vif-deleted:f9431e24-7b8e-44ca-98bc-9b3523052435 for instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b on hv-cinder-83699 May 11 10:02:48.593693 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-239ffd8b-ee46-4000-851a-404c11dd037b req-f5cae0c1-78f3-41a9-a1cf-6a50beb37f6b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152990 May 11 10:02:48.594253 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 461/932] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:02:48.797914 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:48.798612 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:48.805546 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:48.805997 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:48.806766 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:48.807201 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:48.838878 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:48.839321 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:48.839794 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lazy-loading 'fault' on Instance uuid 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:02:48.896631 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:48.905137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-9d4e7e2f-bf7b-4609-8df2-a351d95c9362 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 200 len: 1308 microversion: 2.1 time: 0.111247 May 11 10:02:48.905715 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 472/933] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:48 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:49.924065 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:49.924775 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:49.930948 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:49.931397 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:49.932208 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:49.932686 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:49.945564 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] HTTP exception thrown: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Request method failure captured: May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b HTTP/1.1 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4mUsfMpmqSYP9ixSO6F3foJNM3CE-UCAh-IknGOjKfSy8Fra34cYyfxBTrg6uDqzdnOETKGK11t3VSsPF9Quzc0gbioPTlGCiQevOZ_mWuGR4jGGzQgU0-PjRNdDkixzbBdTj-BT-ptyuqFGiWjaMYSOyLIK_nv5a2s0Ubl5Y38K-U May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: 6242ea8efd81485693f00c4cd1edc5b4 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:02:49.947176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6242ea8efd81485693f00c4cd1edc5b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: 6242ea8efd81485693f00c4cd1edc5b4 May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-VolumesSnapshotTestJSON-1058238586-project May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: acfd655c27b54d0cb6bc8942536f46dc May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-VolumesSnapshotTestJSON-1058238586-project May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. May 11 10:02:49.948868 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b'} May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:02:49.949865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. May 11 10:02:49.951499 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:02:49.953028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Returning 404 to user: Instance 3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:02:49.953028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-972c4f09-f865-49d9-a336-15e182e97e78 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b" status: 404 len: 111 microversion: 2.1 time: 0.029262 May 11 10:02:49.953028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 462/934] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:49 2022] GET /compute/v2.1/servers/3c8f5947-1e9f-46aa-bb2e-96af3fdedd3b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:02:57.665245 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-600330660", "imageRef": "4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4", "flavorRef": "452", "networks": [{"uuid": "7fe5885e-0a49-4190-b49b-48f87998205a"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:02:57.719302 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] validate_networks() for [('7fe5885e-0a49-4190-b49b-48f87998205a', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 10:02:58.097200 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 10:02:58.097775 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 10:02:58.098267 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 10:02:58.098690 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 10:02:58.099092 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 10:02:58.107944 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:58.108389 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:58.109189 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:58.109619 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:58.126034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Getting quotas for project 6242ea8efd81485693f00c4cd1edc5b4. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:02:58.129817 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Getting quotas for user acfd655c27b54d0cb6bc8942536f46dc and project 6242ea8efd81485693f00c4cd1edc5b4. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:02:58.140901 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 10:02:58.143138 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4821c6be-9dfc-4d7f-86f9-aa1fbd8a6cd4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 10:02:58.188075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-25777ad7-6db8-42a9-bd86-6b099868e797 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527203 May 11 10:02:58.188932 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 473/935] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 10:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 11 10:02:58.199111 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-20180f9e-4e6e-480e-bd82-3758d0364c52 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:58.199863 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-20180f9e-4e6e-480e-bd82-3758d0364c52 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:58.256907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-20180f9e-4e6e-480e-bd82-3758d0364c52 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:58.263444 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-20180f9e-4e6e-480e-bd82-3758d0364c52 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1218 microversion: 2.1 time: 0.068138 May 11 10:02:58.264131 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 463/936] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:58 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:02:59.280866 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:02:59.281470 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:02:59.287913 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:59.288365 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:59.289130 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:02:59.289567 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:02:59.364461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:02:59.372341 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-2872206d-c627-47b1-bfb1-e77db1302e88 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1276 microversion: 2.1 time: 0.095783 May 11 10:02:59.372908 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 474/937] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:02:59 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:00.388979 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:00.389577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:00.398012 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:00.398469 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:00.399236 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:00.399678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:00.525899 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:00.533051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-364de88a-6bdb-4e75-9907-508361a2e958 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.148138 May 11 10:03:00.533608 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 464/938] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:00 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:00.640288 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-0bf39877-664c-46de-888f-2de776386ddf req-442bed2f-a626-442c-b101-daf7afe60542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23e6e399-959e-4d3b-bc9a-2851882ac331", "tag": "191a14ef-dc6c-406f-aed1-450e85c2b267"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:00.648943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-0bf39877-664c-46de-888f-2de776386ddf req-442bed2f-a626-442c-b101-daf7afe60542 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:00.649384 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-0bf39877-664c-46de-888f-2de776386ddf req-442bed2f-a626-442c-b101-daf7afe60542 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:00.660472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-0bf39877-664c-46de-888f-2de776386ddf req-442bed2f-a626-442c-b101-daf7afe60542 service nova] Creating event network-changed:191a14ef-dc6c-406f-aed1-450e85c2b267 for instance 23e6e399-959e-4d3b-bc9a-2851882ac331 on hv-cinder-83699 May 11 10:03:00.666365 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-0bf39877-664c-46de-888f-2de776386ddf req-442bed2f-a626-442c-b101-daf7afe60542 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029888 May 11 10:03:00.667217 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 475/939] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:03:01.550391 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:01.550911 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:01.557858 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:01.558311 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:01.559071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:01.559504 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:01.691945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:01.699186 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-1a36eb9c-7e0c-4c81-bc27-4e615a61be8d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.152756 May 11 10:03:01.699777 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 465/940] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:01 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:02.716792 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:02.717478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:02.723552 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:02.724020 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:02.724773 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:02.725202 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:02.855210 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:02.862685 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d0d6e828-c67d-4f11-9539-b9c29dcdbcb1 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.150322 May 11 10:03:02.863265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 476/941] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:02 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:03.879537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:03.880217 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:03.886416 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:03.886857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:03.887610 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:03.888057 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:04.014921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:04.022306 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-7ec4a1b4-0b96-4f70-a131-3f4e8295030c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.146863 May 11 10:03:04.022877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 466/942] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:03 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:05.038565 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:05.039104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:05.045642 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:05.046084 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:05.046845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:05.047272 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:05.171253 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:05.179006 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1036557e-42ae-4cd8-8608-df57eb3e8320 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.144371 May 11 10:03:05.179568 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 477/943] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:05 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:06.143537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-da6d5713-dd4c-4423-b45c-9f09ac46484e req-a04706b1-dd5a-40c9-9e0c-895eef2f5d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6e399-959e-4d3b-bc9a-2851882ac331", "name": "network-vif-plugged", "status": "completed", "tag": "191a14ef-dc6c-406f-aed1-450e85c2b267"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:06.152051 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-da6d5713-dd4c-4423-b45c-9f09ac46484e req-a04706b1-dd5a-40c9-9e0c-895eef2f5d77 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:06.152363 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-da6d5713-dd4c-4423-b45c-9f09ac46484e req-a04706b1-dd5a-40c9-9e0c-895eef2f5d77 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:06.162779 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-da6d5713-dd4c-4423-b45c-9f09ac46484e req-a04706b1-dd5a-40c9-9e0c-895eef2f5d77 service nova] Creating event network-vif-plugged:191a14ef-dc6c-406f-aed1-450e85c2b267 for instance 23e6e399-959e-4d3b-bc9a-2851882ac331 on hv-cinder-83699 May 11 10:03:06.168120 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-da6d5713-dd4c-4423-b45c-9f09ac46484e req-a04706b1-dd5a-40c9-9e0c-895eef2f5d77 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081152 May 11 10:03:06.168688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 467/944] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:03:06.195676 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:06.196255 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:06.203809 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:06.204262 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:06.205052 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:06.205494 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:06.372847 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:06.380303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-47166f96-8f4a-43a1-aa54-708352d51793 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1318 microversion: 2.1 time: 0.189067 May 11 10:03:06.381657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 478/945] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:06 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:07.398087 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:07.398780 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:07.404952 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:07.405399 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:07.406158 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:07.406590 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:07.531344 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:07.539159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-123ba250-5b67-4008-8d78-9ecefe493e0c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1507 microversion: 2.1 time: 0.145777 May 11 10:03:07.539741 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 468/946] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:07 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:07.556253 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0337fa-5be4-43ec-93b1-ab92b41c4dd3", "device": "/dev/sdb"}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:07.557357 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:07.563682 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:07.564185 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:07.564973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:07.565436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:07.859771 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2c66f20-113b-40d4-839f-d80fefb2638e tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "POST /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307969 May 11 10:03:07.860379 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 479/947] 10.222.0.44 () {60 vars in 1322 bytes} [Wed May 11 10:03:07 2022] POST /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:03:14.862110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:14.862602 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:14.869855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:14.870302 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:14.871070 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:14.871500 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:14.907968 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:03:14.942038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-0be42b47-af12-455a-bd8d-ac61f73c82c6 req-d150b2e2-6c40-4a69-b653-6d6992a1662a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:14.957026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-0be42b47-af12-455a-bd8d-ac61f73c82c6 req-d150b2e2-6c40-4a69-b653-6d6992a1662a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:14.957701 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-0be42b47-af12-455a-bd8d-ac61f73c82c6 req-d150b2e2-6c40-4a69-b653-6d6992a1662a service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:14.972531 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-0be42b47-af12-455a-bd8d-ac61f73c82c6 req-d150b2e2-6c40-4a69-b653-6d6992a1662a service nova] Creating event network-changed:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 10:03:14.979797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-0be42b47-af12-455a-bd8d-ac61f73c82c6 req-d150b2e2-6c40-4a69-b653-6d6992a1662a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117725 May 11 10:03:14.980421 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 480/948] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 10:03:15.003293 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3b5cadf7-519e-4253-8630-7b265fe9c24d tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 204 len: 0 microversion: 2.1 time: 0.144649 May 11 10:03:15.004879 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 469/949] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:03:14 2022] DELETE /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:03:15.013661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:15.014366 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:15.021810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:15.022312 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:15.023104 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:15.023540 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:15.160286 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:15.168490 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-65403c4c-4103-4dbf-9175-a23381d32eef tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.159135 May 11 10:03:15.169067 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 481/950] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:15 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:03:16.187076 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:16.187794 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:16.195459 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:16.195989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:16.196761 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:16.197191 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:16.332241 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:16.341858 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-537122b8-ef4a-4f07-92fe-eee51ac64313 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.159111 May 11 10:03:16.342415 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 470/951] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:16 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:17.358892 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:17.359503 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:17.365858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:17.366293 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:17.367053 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:17.367483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:17.495980 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:17.503354 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3cf34555-e814-4f42-96a7-a72ccfd90a35 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.148309 May 11 10:03:17.503952 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 482/952] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:17 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:18.521341 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:18.522043 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:18.529053 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:18.529498 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:18.530260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:18.530687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:18.666254 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:18.673825 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-bbc79468-8b58-400f-b4fe-e69393cd6d5a tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.156449 May 11 10:03:18.674377 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 471/953] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:18 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:19.692007 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:19.692618 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:19.698858 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:19.699297 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:19.700088 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:19.700548 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:19.826614 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:19.833927 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8095e6f0-801c-43da-bca2-005b993ee226 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.145892 May 11 10:03:19.834486 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 483/954] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:19 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:20.852005 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:20.852617 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:20.858700 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:20.859151 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:20.859942 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:20.860376 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:21.007121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:21.017529 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-66ab7ae3-3b92-49ac-9894-500c2ddabc52 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1569 microversion: 2.1 time: 0.169115 May 11 10:03:21.018252 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 472/955] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:20 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:21.562551 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-5d0d9a5e-41d9-408b-b4b0-93fcd280a889 req-3bfc3d51-d83a-45d3-8162-06f8c049273b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10de351-bb53-4c50-92e8-25d6c8e805bd", "name": "network-vif-deleted", "tag": "c268e868-5cf5-4617-b581-12e013e80d06"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:21.571638 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5d0d9a5e-41d9-408b-b4b0-93fcd280a889 req-3bfc3d51-d83a-45d3-8162-06f8c049273b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:21.572116 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-5d0d9a5e-41d9-408b-b4b0-93fcd280a889 req-3bfc3d51-d83a-45d3-8162-06f8c049273b service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:21.585522 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-5d0d9a5e-41d9-408b-b4b0-93fcd280a889 req-3bfc3d51-d83a-45d3-8162-06f8c049273b service nova] Creating event network-vif-deleted:c268e868-5cf5-4617-b581-12e013e80d06 for instance e10de351-bb53-4c50-92e8-25d6c8e805bd on hv-cinder-83699 May 11 10:03:21.592860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-5d0d9a5e-41d9-408b-b4b0-93fcd280a889 req-3bfc3d51-d83a-45d3-8162-06f8c049273b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 May 11 10:03:21.593943 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 484/956] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:03:22.035139 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:22.035921 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:22.043072 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:22.043603 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:22.044447 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:22.044873 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:22.081227 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:22.081907 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:22.082462 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lazy-loading 'fault' on Instance uuid e10de351-bb53-4c50-92e8-25d6c8e805bd {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:03:22.127461 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8034a3f2eff04f798aad85721934c024', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581a43958ce14c81832b5f1bf5622763', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:22.136409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-64cb1d6a-dd68-4fb4-9f6a-52ba559bf8b1 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 200 len: 1223 microversion: 2.1 time: 0.105842 May 11 10:03:22.140287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 473/957] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:22 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:23.153904 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:23.154621 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] [instance: e10de351-bb53-4c50-92e8-25d6c8e805bd] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:23.161026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:23.161408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:23.162163 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:23.162605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:23.176455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] HTTP exception thrown: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Request method failure captured: May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd HTTP/1.1 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4jPljwhjnkdQdUlDnZATni3fngjvgq5TFHah8TnG6RSN6LtMtoXUGFUYvG0-gG0JSzhXfDEbvavkoLPZf8DZq5Hz-hBJ9ph17RRAwWTLwh59DWqpwJLRK2zDYT8sWdAdLavCy1WMoNw0I-j-oynC5hWxrjoi_m4eKiYslm3eOv60RE May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 581a43958ce14c81832b5f1bf5622763 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-TestShelveInstance-1951650479 May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:03:23.178083 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/581a43958ce14c81832b5f1bf5622763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/581a43958ce14c81832b5f1bf5622763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_581a43958ce14c81832b5f1bf5622763", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/581a43958ce14c81832b5f1bf5622763"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-TestShelveInstance-1951650479 May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 581a43958ce14c81832b5f1bf5622763 May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-TestShelveInstance-1951650479 May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-TestShelveInstance-1951650479-project May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: 8034a3f2eff04f798aad85721934c024 May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-TestShelveInstance-1951650479-project May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. May 11 10:03:23.179833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': 'e10de351-bb53-4c50-92e8-25d6c8e805bd'} May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:03:23.180861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. May 11 10:03:23.182405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:23.184328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Returning 404 to user: Instance e10de351-bb53-4c50-92e8-25d6c8e805bd could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:03:23.184328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-620837fa-8733-40f0-9a1e-00c007d527b8 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd" status: 404 len: 111 microversion: 2.1 time: 0.030229 May 11 10:03:23.184328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 485/958] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:23 2022] GET /compute/v2.1/servers/e10de351-bb53-4c50-92e8-25d6c8e805bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:03:23.339857 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-44ed3f44-f6f7-4564-8ba9-b74338202262 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] Calling method '.version_select at 0x7f8bcd37fd30>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:23.357098 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-44ed3f44-f6f7-4564-8ba9-b74338202262 tempest-TestShelveInstance-1951650479 tempest-TestShelveInstance-1951650479-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615077066" status: 202 len: 0 microversion: 2.1 time: 0.021747 May 11 10:03:23.357669 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 474/959] 10.222.0.44 () {58 vars in 1250 bytes} [Wed May 11 10:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-615077066 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:03:24.034693 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:24.035733 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:24.042482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:24.043180 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:24.043989 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:24.044428 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:24.123402 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lazy-loading 'services' on Instance uuid 23e6e399-959e-4d3b-bc9a-2851882ac331 {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:03:24.193853 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0bd5d926-c38f-4120-8300-a1e54541339d tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "DELETE /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331/os-volume_attachments/9a0337fa-5be4-43ec-93b1-ab92b41c4dd3" status: 202 len: 0 microversion: 2.1 time: 0.163052 May 11 10:03:24.194971 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 486/960] 10.222.0.44 () {58 vars in 1415 bytes} [Wed May 11 10:03:24 2022] DELETE /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331/os-volume_attachments/9a0337fa-5be4-43ec-93b1-ab92b41c4dd3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:03:25.321330 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:25.322405 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:25.328876 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:25.329328 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:25.330106 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:25.330525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:25.355031 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:03:25.443580 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-33b15e83-b292-4193-ae68-c3be4997aab8 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "DELETE /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 204 len: 0 microversion: 2.1 time: 0.126714 May 11 10:03:25.444409 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 475/961] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:03:25 2022] DELETE /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:03:25.454184 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:25.455413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:25.461734 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:25.462181 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:25.462962 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:25.463413 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:25.883562 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:25.891986 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-51d2a31f-d3a0-4ede-8619-a9411fe533f5 tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1513 microversion: 2.1 time: 0.442438 May 11 10:03:25.893240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 487/962] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:25 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1513 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:03:26.911109 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:26.911905 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:26.919038 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:26.919485 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:26.920275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:26.920711 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:27.056327 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:27.064071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-a8dbabd5-6c4b-4982-9bdb-9b6796e9472c tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1513 microversion: 2.1 time: 0.157138 May 11 10:03:27.064637 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 476/963] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:26 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:27.781657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-e6a77dac-fd78-4679-95f5-b44280f6cb56 req-4e094c31-e1e8-476f-aada-18c3d18047fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23e6e399-959e-4d3b-bc9a-2851882ac331", "name": "network-vif-deleted", "tag": "191a14ef-dc6c-406f-aed1-450e85c2b267"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:03:27.792063 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e6a77dac-fd78-4679-95f5-b44280f6cb56 req-4e094c31-e1e8-476f-aada-18c3d18047fd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:27.792506 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-e6a77dac-fd78-4679-95f5-b44280f6cb56 req-4e094c31-e1e8-476f-aada-18c3d18047fd service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:27.805073 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-e6a77dac-fd78-4679-95f5-b44280f6cb56 req-4e094c31-e1e8-476f-aada-18c3d18047fd service nova] Creating event network-vif-deleted:191a14ef-dc6c-406f-aed1-450e85c2b267 for instance 23e6e399-959e-4d3b-bc9a-2851882ac331 on hv-cinder-83699 May 11 10:03:27.809896 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-e6a77dac-fd78-4679-95f5-b44280f6cb56 req-4e094c31-e1e8-476f-aada-18c3d18047fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032002 May 11 10:03:27.810486 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 488/964] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:03:28.091634 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:28.101373 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:28.118235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:28.118688 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:28.119475 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:28.119946 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:28.155969 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:28.156724 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:28.157720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.objects.instance [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lazy-loading 'fault' on Instance uuid 23e6e399-959e-4d3b-bc9a-2851882ac331 {{(pid=123393) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:03:28.215149 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acfd655c27b54d0cb6bc8942536f46dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6242ea8efd81485693f00c4cd1edc5b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:03:28.231467 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-623dc42b-ca93-44f8-9e00-a92fdb4b26cb tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 200 len: 1308 microversion: 2.1 time: 0.147267 May 11 10:03:28.232079 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 477/965] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:28 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 1308 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:03:29.249787 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:03:29.250469 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] [instance: 23e6e399-959e-4d3b-bc9a-2851882ac331] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:03:29.257300 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:29.257893 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:29.258823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:03:29.259369 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:03:29.273034 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] HTTP exception thrown: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Request method failure captured: May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 HTTP/1.1 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4mUsfMpmqSYP9ixSO6F3foJNM3CE-UCAh-IknGOjKfSy8Fra34cYyfxBTrg6uDqzdnOETKGK11t3VSsPF9Quzc0gbioPTlGCiQevOZ_mWuGR4jGGzQgU0-PjRNdDkixzbBdTj-BT-ptyuqFGiWjaMYSOyLIK_nv5a2s0Ubl5Y38K-U May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: 6242ea8efd81485693f00c4cd1edc5b4 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:03:29.274887 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6242ea8efd81485693f00c4cd1edc5b4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6242ea8efd81485693f00c4cd1edc5b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: 6242ea8efd81485693f00c4cd1edc5b4 May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1058238586 May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-VolumesSnapshotTestJSON-1058238586-project May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: acfd655c27b54d0cb6bc8942536f46dc May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-VolumesSnapshotTestJSON-1058238586-project May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. May 11 10:03:29.276704 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '23e6e399-959e-4d3b-bc9a-2851882ac331'} May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:03:29.277654 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. May 11 10:03:29.279156 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:03:29.280473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] Returning 404 to user: Instance 23e6e399-959e-4d3b-bc9a-2851882ac331 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:03:29.280473 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-c04a7225-a61b-4455-b4be-a252d1a2adae tempest-VolumesSnapshotTestJSON-1058238586 tempest-VolumesSnapshotTestJSON-1058238586-project] 10.222.0.44 "GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331" status: 404 len: 111 microversion: 2.1 time: 0.032106 May 11 10:03:29.282355 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 489/966] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:03:29 2022] GET /compute/v2.1/servers/23e6e399-959e-4d3b-bc9a-2851882ac331 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:03:45.635845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:03:45.636521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Wed May 11 10:03:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:04:03.373028 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:03.373613 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:03.379521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:03.380006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:03.380761 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:03.381190 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:03.407967 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Going to try to terminate instance {{(pid=123393) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:04:03.482503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-941650ee-3491-47b2-a824-dbd8ea85706e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 204 len: 0 microversion: 2.1 time: 0.113635 May 11 10:04:03.483150 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 478/967] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:04:03 2022] DELETE /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:04:03.491487 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:03.492125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:03.499153 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:03.499599 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:03.500390 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:03.500833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:03.632074 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:03.640105 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-64ca4125-e94a-4462-ba41-5054d0c60dcf tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1574 microversion: 2.1 time: 0.152573 May 11 10:04:03.640670 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 490/968] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:03 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:04:04.657752 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:04.658445 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:04.664928 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:04.665358 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:04.666112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:04.666537 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:04.796175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:04.803624 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-07783775-48fb-4469-9909-389750731617 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1574 microversion: 2.1 time: 0.150090 May 11 10:04:04.804312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 479/969] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:04 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:05.828521 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:05.829389 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-9cf6fb4a-c5bb-4a39-8a04-038b3e22cf2f req-74c20678-d587-45b0-9f14-8d030f366358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b23ffe8-185c-40fa-a29e-ddca19f85158", "name": "network-vif-deleted", "tag": "50fd9419-effb-444f-aeda-d1eca1fde3e6"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:04:05.831026 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:05.845137 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:05.845626 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:05.849672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:05.850173 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:05.851891 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-9cf6fb4a-c5bb-4a39-8a04-038b3e22cf2f req-74c20678-d587-45b0-9f14-8d030f366358 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:05.852325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-9cf6fb4a-c5bb-4a39-8a04-038b3e22cf2f req-74c20678-d587-45b0-9f14-8d030f366358 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:05.874732 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-9cf6fb4a-c5bb-4a39-8a04-038b3e22cf2f req-74c20678-d587-45b0-9f14-8d030f366358 service nova] Creating event network-vif-deleted:50fd9419-effb-444f-aeda-d1eca1fde3e6 for instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 on hv-cinder-83699 May 11 10:04:05.889635 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-9cf6fb4a-c5bb-4a39-8a04-038b3e22cf2f req-74c20678-d587-45b0-9f14-8d030f366358 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070651 May 11 10:04:05.890381 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 480/970] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:04:05.944315 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:05.956803 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-8df29ad1-1b8c-41aa-91ad-6ebf8ee68499 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 200 len: 1225 microversion: 2.1 time: 0.135479 May 11 10:04:05.957375 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 491/971] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:05 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 1225 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:06.973859 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:06.974550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:06.981235 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:06.981678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:06.982427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:06.982855 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:06.996503 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] HTTP exception thrown: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Request method failure captured: May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 HTTP/1.1 May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4lqpmhJPVd4p4SZd-wOyVUvEndG3Sf6BGnsfG6x3BTS7JUkNwrTDepiBtxHe8PLLhDZlL40cRJjot1j78xL1EqOjYdebqr3sXc8Q4IN5HqOwyDYCrCFHCjcTzrHwEzH-XHetlw1Zbo1-7wiT7lrJRbV2feTWiz4c6k2zwlU-1m-oAs May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:04:06.998110 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a4fff07e7c4d406bab0ec2d4ac48eaca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-TestVolumeBootPattern-616602638 May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-TestVolumeBootPattern-616602638-project May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: e457b7d59444405c89fb15e989245889 May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-TestVolumeBootPattern-616602638-project May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:04:06.999815 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '7b23ffe8-185c-40fa-a29e-ddca19f85158'} May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:04:07.000862 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:04:07.002229 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:04:07.003404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Returning 404 to user: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:04:07.003404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-fd8770ad-35d4-484b-993f-ffa459d9a69e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 404 len: 111 microversion: 2.1 time: 0.029842 May 11 10:04:07.003404 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 481/972] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:06 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:04:07.090990 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-570704247", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1603837308", "security_groups": [{"name": "tempest-secgroup-smoke-1774664988"}], "block_device_mapping_v2": [{"uuid": "56bf24c8-9419-4e49-a6e7-19dbbaa81079", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c44cd1a1-c51a-4594-a7a3-35c53d0c159d"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:04:07.198587 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] validate_networks() for [('c44cd1a1-c51a-4594-a7a3-35c53d0c159d', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 10:04:07.555659 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 10:04:07.556114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 10:04:07.556591 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 10:04:07.557000 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 10:04:07.557527 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 10:04:07.566728 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:07.567178 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:07.568038 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:07.568475 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:07.584364 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:04:07.588224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for user e457b7d59444405c89fb15e989245889 and project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:04:07.643514 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 10:04:07.645647 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='56bf24c8-9419-4e49-a6e7-19dbbaa81079',volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 10:04:07.785114 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-0f9d2a57-d32a-4d4a-8487-d990ce462720 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.698208 May 11 10:04:07.785761 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 492/973] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 10:04:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 10:04:07.796545 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-51d54bbc-ffc0-45ac-9d99-d94da18c87f1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:07.797165 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-51d54bbc-ffc0-45ac-9d99-d94da18c87f1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:07.852900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-51d54bbc-ffc0-45ac-9d99-d94da18c87f1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:07.860473 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-51d54bbc-ffc0-45ac-9d99-d94da18c87f1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1094 microversion: 2.1 time: 0.068797 May 11 10:04:07.861126 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 482/974] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:07 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:08.877831 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:08.878677 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:08.885211 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:08.885737 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:08.886517 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:08.887112 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:08.964298 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:08.973258 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cd94f861-11d3-46f2-a826-f7d9e178909f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1210 microversion: 2.1 time: 0.099288 May 11 10:04:08.973823 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 493/975] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:08 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:09.990134 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:09.991006 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:09.999086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:09.999926 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:10.001831 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:10.002676 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:10.019661 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-221ed86d-d1fa-4984-9727-d8848b2a6c69 req-a37a7751-f68e-4265-b6f8-c460a720ce80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc042a1a-50b5-487f-af7a-4892334ae98d", "tag": "f1ca2d13-b602-47e9-b62d-87593dae121c"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:04:10.037754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-221ed86d-d1fa-4984-9727-d8848b2a6c69 req-a37a7751-f68e-4265-b6f8-c460a720ce80 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:10.041788 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-221ed86d-d1fa-4984-9727-d8848b2a6c69 req-a37a7751-f68e-4265-b6f8-c460a720ce80 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:10.064065 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-221ed86d-d1fa-4984-9727-d8848b2a6c69 req-a37a7751-f68e-4265-b6f8-c460a720ce80 service nova] Creating event network-changed:f1ca2d13-b602-47e9-b62d-87593dae121c for instance cc042a1a-50b5-487f-af7a-4892334ae98d on hv-cinder-83699 May 11 10:04:10.069502 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-221ed86d-d1fa-4984-9727-d8848b2a6c69 req-a37a7751-f68e-4265-b6f8-c460a720ce80 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054060 May 11 10:04:10.070094 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 494/976] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 10:04:10.165661 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:10.174074 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-334ce140-5d89-4b40-bb35-2929e951c10b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.187831 May 11 10:04:10.174649 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 483/977] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:09 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:11.192483 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:11.193177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:11.199214 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:11.199658 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:11.200445 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:11.200885 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:11.327946 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:11.335124 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-ebecd94a-ab4c-4f1e-90db-cea710f2685b tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.147405 May 11 10:04:11.335674 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 495/978] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:11 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:12.352018 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:12.352577 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:12.359536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:12.360010 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:12.360774 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:12.361210 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:12.488314 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:12.495492 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3091b83b-fda7-4e4b-9e0b-f8dd7c9d04f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.147509 May 11 10:04:12.496086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 484/979] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:12 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:13.512741 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:13.513274 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:13.520160 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:13.520601 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:13.521358 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:13.521807 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:13.649482 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:13.657250 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-1045a02e-de2e-4cec-ae07-b63eb041b9ab tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.148450 May 11 10:04:13.657812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 496/980] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:13 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:14.674869 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:14.675483 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:14.681865 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:14.682315 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:14.683084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:14.683526 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:14.813116 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:14.820323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-2f1414de-a0c0-4e87-a41f-68b9b8d95c5d tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.150222 May 11 10:04:14.820989 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 485/981] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:14 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:15.837765 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:15.838458 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:15.845628 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:15.846097 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:15.847047 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:15.847538 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:15.974663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:15.982075 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-227ee317-585a-44a4-8139-2d3ff3c94154 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.148241 May 11 10:04:15.982636 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 497/982] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:15 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:16.999521 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:17.000145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:17.006778 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:17.007220 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:17.008025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:17.008448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:17.135720 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:17.144082 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ccca0349-2d09-4c6d-a92c-fff126b8e2cd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.148862 May 11 10:04:17.145084 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 486/983] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:16 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:18.161131 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:18.161718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:18.168045 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:18.168489 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:18.169244 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:18.169679 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:18.295849 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:18.306281 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-6770f792-f500-4bcc-a058-805c3f701b75 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.148948 May 11 10:04:18.306886 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 498/984] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:18 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:19.324680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:19.325287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:19.331853 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:19.332304 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:19.333095 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:19.333531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:19.462064 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:19.469835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ebaf1a48-9afc-4246-ae52-c1ae9e92f0a8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.148965 May 11 10:04:19.470325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 487/985] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:19 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:20.470076 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [req-389b1bcd-a866-4b53-8751-ec370ee4f1d6 req-b7dc502e-06da-40ee-998a-2e2408291a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc042a1a-50b5-487f-af7a-4892334ae98d", "name": "network-vif-plugged", "status": "completed", "tag": "f1ca2d13-b602-47e9-b62d-87593dae121c"}]} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:04:20.478419 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-389b1bcd-a866-4b53-8751-ec370ee4f1d6 req-b7dc502e-06da-40ee-998a-2e2408291a4e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:20.478878 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [req-389b1bcd-a866-4b53-8751-ec370ee4f1d6 req-b7dc502e-06da-40ee-998a-2e2408291a4e service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:20.486851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:20.487463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:20.490029 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.compute.server_external_events [req-389b1bcd-a866-4b53-8751-ec370ee4f1d6 req-b7dc502e-06da-40ee-998a-2e2408291a4e service nova] Creating event network-vif-plugged:f1ca2d13-b602-47e9-b62d-87593dae121c for instance cc042a1a-50b5-487f-af7a-4892334ae98d on hv-cinder-83699 May 11 10:04:20.494990 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:20.495132 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [req-389b1bcd-a866-4b53-8751-ec370ee4f1d6 req-b7dc502e-06da-40ee-998a-2e2408291a4e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028659 May 11 10:04:20.495489 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:20.495973 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 499/986] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:04:20.496287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:20.496717 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:20.634832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:20.642986 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-789777b7-c25a-4a22-a5c8-ea53e8223664 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.160388 May 11 10:04:20.643588 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 488/987] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:20 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:04:21.660969 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:21.662529 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:21.668663 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:21.669108 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:21.669877 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:21.671082 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:21.798464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:21.805615 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f9a44c2c-725e-47b3-b8d4-3ee749f33a82 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1266 microversion: 2.1 time: 0.149731 May 11 10:04:21.806166 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 500/988] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:21 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:22.822767 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:22.823368 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:22.830536 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:22.830982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:22.831764 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:22.832204 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:22.960725 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:22.968612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-3df67b63-0b12-46ca-a72c-88592eb06cf8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1452 microversion: 2.1 time: 0.149759 May 11 10:04:22.969172 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 489/989] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:22 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:22.984408 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:04:22.985040 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:04:22.991481 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:22.991960 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:22.992747 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:22.993180 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:23.125013 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:04:23.132280 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-11e61b0e-e788-4cf6-9a8a-ecb9812c6b23 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1452 microversion: 2.1 time: 0.151706 May 11 10:04:23.132842 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 501/990] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:04:22 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:04:25.001835 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-0dc23e86-e6d7-44e9-bff8-ffe3a7fdef7e req-e8cde684-20b9-42ca-a5d7-562668dbc665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc042a1a-50b5-487f-af7a-4892334ae98d", "tag": "f1ca2d13-b602-47e9-b62d-87593dae121c"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:04:25.009975 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-0dc23e86-e6d7-44e9-bff8-ffe3a7fdef7e req-e8cde684-20b9-42ca-a5d7-562668dbc665 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:04:25.010866 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-0dc23e86-e6d7-44e9-bff8-ffe3a7fdef7e req-e8cde684-20b9-42ca-a5d7-562668dbc665 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:04:25.021406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-0dc23e86-e6d7-44e9-bff8-ffe3a7fdef7e req-e8cde684-20b9-42ca-a5d7-562668dbc665 service nova] Creating event network-changed:f1ca2d13-b602-47e9-b62d-87593dae121c for instance cc042a1a-50b5-487f-af7a-4892334ae98d on hv-cinder-83699 May 11 10:04:25.027923 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-0dc23e86-e6d7-44e9-bff8-ffe3a7fdef7e req-e8cde684-20b9-42ca-a5d7-562668dbc665 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030209 May 11 10:04:25.028584 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 490/991] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:04:43.292078 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:04:43.292687 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:04:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:05:58.185815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-838785495", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1603837308", "security_groups": [{"name": "tempest-secgroup-smoke-1774664988"}], "block_device_mapping_v2": [{"uuid": "b347d212-5e35-4b7f-98d5-2d7b16e56be4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c44cd1a1-c51a-4594-a7a3-35c53d0c159d"}]}} {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:05:58.296568 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.network.neutron [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] validate_networks() for [('c44cd1a1-c51a-4594-a7a3-35c53d0c159d', None, None, None, None, None)] {{(pid=123392) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 11 10:05:58.644815 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 11 10:05:58.645238 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image limits 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 11 10:05:58.645711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Flavor pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 11 10:05:58.646119 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Image pref 0:0:0 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 11 10:05:58.646526 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.virt.hardware [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123392) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 11 10:05:58.655955 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:05:58.656349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:05:58.657146 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:05:58.657583 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:05:58.675605 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 11 10:05:58.679718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.quota [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Getting quotas for user e457b7d59444405c89fb15e989245889 and project a4fff07e7c4d406bab0ec2d4ac48eaca. Resources: {'instances', 'cores', 'ram'} {{(pid=123392) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 11 10:05:58.733718 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Going to run 1 instances... {{(pid=123392) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 11 10:05:58.735818 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b347d212-5e35-4b7f-98d5-2d7b16e56be4',volume_size=None,volume_type=None)] {{(pid=123392) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 11 10:05:58.855451 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-3d892936-7662-47ae-b97a-59139a6e41e9 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674575 May 11 10:05:58.856125 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 502/992] 10.222.0.44 () {60 vars in 1146 bytes} [Wed May 11 10:05:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 11 10:05:58.867703 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-42b1181f-37b9-41ef-8365-c51c3f88fbb8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:05:58.868413 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-42b1181f-37b9-41ef-8365-c51c3f88fbb8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:05:58.921964 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-42b1181f-37b9-41ef-8365-c51c3f88fbb8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:05:58.929099 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-42b1181f-37b9-41ef-8365-c51c3f88fbb8 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1094 microversion: 2.1 time: 0.066849 May 11 10:05:58.929673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 491/993] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:05:58 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:05:59.945464 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:05:59.946081 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:05:59.954135 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:05:59.954584 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:05:59.955405 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:05:59.955953 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:00.045861 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:00.053762 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-736c4c4e-7c47-4646-bc4f-3d4b32be3d39 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1210 microversion: 2.1 time: 0.112208 May 11 10:06:00.054319 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 503/994] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:05:59 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:01.062992 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-d9c18d57-809c-4657-aeec-2b7c997ffdf6 req-44c2d3f4-a8aa-4dae-94bb-bc6a2ab8d44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495ebf9-73ef-4bd4-9bad-040fa3dccfda", "tag": "2fc915fb-d1a7-4ed5-b086-e945a5d437e5"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:06:01.071000 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:01.072145 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d9c18d57-809c-4657-aeec-2b7c997ffdf6 req-44c2d3f4-a8aa-4dae-94bb-bc6a2ab8d44f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:01.072867 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d9c18d57-809c-4657-aeec-2b7c997ffdf6 req-44c2d3f4-a8aa-4dae-94bb-bc6a2ab8d44f service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:01.074214 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:01.080846 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:01.081330 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:01.082113 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:01.082880 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:01.086086 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-d9c18d57-809c-4657-aeec-2b7c997ffdf6 req-44c2d3f4-a8aa-4dae-94bb-bc6a2ab8d44f service nova] Creating event network-changed:2fc915fb-d1a7-4ed5-b086-e945a5d437e5 for instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda on hv-cinder-83699 May 11 10:06:01.092104 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-d9c18d57-809c-4657-aeec-2b7c997ffdf6 req-44c2d3f4-a8aa-4dae-94bb-bc6a2ab8d44f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032646 May 11 10:06:01.093249 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 492/995] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:06:01.313958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:01.321429 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-5d676262-11e6-412e-b763-4c21cf560ebe tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.254168 May 11 10:06:01.322000 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 504/996] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:01 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:02.339707 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:02.340423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:02.346525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:02.346970 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:02.347767 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:02.348199 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:02.476993 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:02.484750 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-dd8c9553-d347-48af-a73c-1fb7947d8f09 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.149705 May 11 10:06:02.485308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 493/997] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:02 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:03.504833 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:03.505346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:03.512393 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:03.512836 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:03.513597 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:03.514025 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:03.646295 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:03.653726 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-cde6b9ed-3af5-4882-95a6-291e59bc8412 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.155632 May 11 10:06:03.654285 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 505/998] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:03 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:04.669817 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:04.670406 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:04.676678 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:04.677121 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:04.677877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:04.678308 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:04.810071 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:04.817612 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-76919a9a-7559-4105-8941-66c30034b0dd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.151922 May 11 10:06:04.818163 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 494/999] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:04 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:05.833888 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:05.834493 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:05.841461 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:05.841900 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:05.842653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:05.843081 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:05.967318 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:05.974556 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-778ac964-032b-491f-99b7-e8b92823d8a7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.144525 May 11 10:06:05.975117 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 506/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:05 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:06.991176 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:06.991813 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:06.997690 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:06.998136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:06.998895 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:06.999325 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:07.123380 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:07.130706 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-5515c7c6-536e-4c68-8f4b-0dd4d54efa94 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.143562 May 11 10:06:07.131260 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 495/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:06 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:08.147311 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:08.147958 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:08.154455 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:08.154910 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:08.155712 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:08.156157 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:08.289314 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:08.296873 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-99450926-b07e-434e-b1c5-20aed225c310 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.153447 May 11 10:06:08.297442 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 507/1002] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:08 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:09.313458 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:09.314122 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:09.320399 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:09.320851 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:09.321623 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:09.322056 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:09.449256 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:09.456576 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-ff83944b-0d71-463f-911f-16c4db719dfd tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.147037 May 11 10:06:09.457146 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 496/1003] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:09 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:10.473166 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:10.473771 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:10.480727 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:10.481177 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:10.481940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:10.482376 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:10.613570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:10.620754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-d7a7f0ed-3dab-4626-8518-4b7798718370 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.151475 May 11 10:06:10.621303 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 508/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:10 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:11.059159 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-ed420919-c729-45bb-8bb7-f9e7cbf60038 req-f4cfec9a-e543-4741-b89d-5fb972a540e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495ebf9-73ef-4bd4-9bad-040fa3dccfda", "name": "network-vif-plugged", "status": "completed", "tag": "2fc915fb-d1a7-4ed5-b086-e945a5d437e5"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:06:11.068136 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-ed420919-c729-45bb-8bb7-f9e7cbf60038 req-f4cfec9a-e543-4741-b89d-5fb972a540e5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:11.068531 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-ed420919-c729-45bb-8bb7-f9e7cbf60038 req-f4cfec9a-e543-4741-b89d-5fb972a540e5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:11.080059 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-ed420919-c729-45bb-8bb7-f9e7cbf60038 req-f4cfec9a-e543-4741-b89d-5fb972a540e5 service nova] Creating event network-vif-plugged:2fc915fb-d1a7-4ed5-b086-e945a5d437e5 for instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda on hv-cinder-83699 May 11 10:06:11.084925 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-ed420919-c729-45bb-8bb7-f9e7cbf60038 req-f4cfec9a-e543-4741-b89d-5fb972a540e5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029473 May 11 10:06:11.085509 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 497/1005] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:06:11.637959 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:11.638495 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:11.644812 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:11.645265 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:11.646035 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:11.646472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:11.773940 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:11.781773 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f8b5ac76-ccef-48eb-9ca2-7f465c31ee0f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1266 microversion: 2.1 time: 0.148342 May 11 10:06:11.782328 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 509/1006] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:11 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:12.799640 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:12.800365 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:12.806448 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:12.806904 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:12.807681 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:12.808117 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:12.936351 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:12.943581 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-811d2276-4b2b-4495-a409-d0b253dac8b2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1452 microversion: 2.1 time: 0.148572 May 11 10:06:12.944177 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 498/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:12 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:12.959673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:06:12.960333 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:06:12.967120 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:12.967561 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:12.968349 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:12.968783 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:13.092511 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:06:13.099657 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-123cd8d9-6399-4007-86ca-5f637fdf61f0 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1452 microversion: 2.1 time: 0.143788 May 11 10:06:13.100240 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 510/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:06:12 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:06:15.017619 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-0971db33-a435-424b-8179-350fc8b8142b req-27bbae1a-0ded-4f23-9354-d3c4054a9f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495ebf9-73ef-4bd4-9bad-040fa3dccfda", "tag": "2fc915fb-d1a7-4ed5-b086-e945a5d437e5"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:06:15.025463 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-0971db33-a435-424b-8179-350fc8b8142b req-27bbae1a-0ded-4f23-9354-d3c4054a9f34 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:06:15.026024 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-0971db33-a435-424b-8179-350fc8b8142b req-27bbae1a-0ded-4f23-9354-d3c4054a9f34 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:06:15.036877 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-0971db33-a435-424b-8179-350fc8b8142b req-27bbae1a-0ded-4f23-9354-d3c4054a9f34 service nova] Creating event network-changed:2fc915fb-d1a7-4ed5-b086-e945a5d437e5 for instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda on hv-cinder-83699 May 11 10:06:15.041945 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-0971db33-a435-424b-8179-350fc8b8142b req-27bbae1a-0ded-4f23-9354-d3c4054a9f34 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028562 May 11 10:06:15.043025 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 499/1009] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:06:32.887287 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:06:32.888007 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:06:42.917599 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:06:42.918206 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Wed May 11 10:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:07:05.644187 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:07:05.644744 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Wed May 11 10:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:07:43.345634 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:43.346255 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:43.347436 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-d8e4e46b-d329-4963-9b70-5fa364576d9d req-3b95f1d8-6a87-4aa4-bebb-31e0169f4199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b495ebf9-73ef-4bd4-9bad-040fa3dccfda", "tag": "2fc915fb-d1a7-4ed5-b086-e945a5d437e5"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:07:43.352845 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:43.353353 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:43.354134 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:43.354573 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:43.356047 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d8e4e46b-d329-4963-9b70-5fa364576d9d req-3b95f1d8-6a87-4aa4-bebb-31e0169f4199 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:43.356578 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-d8e4e46b-d329-4963-9b70-5fa364576d9d req-3b95f1d8-6a87-4aa4-bebb-31e0169f4199 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:43.367838 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-d8e4e46b-d329-4963-9b70-5fa364576d9d req-3b95f1d8-6a87-4aa4-bebb-31e0169f4199 service nova] Creating event network-changed:2fc915fb-d1a7-4ed5-b086-e945a5d437e5 for instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda on hv-cinder-83699 May 11 10:07:43.373102 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-d8e4e46b-d329-4963-9b70-5fa364576d9d req-3b95f1d8-6a87-4aa4-bebb-31e0169f4199 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030574 May 11 10:07:43.373984 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 500/1010] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 11 10:07:43.380103 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:07:43.466115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-4940841d-5cf5-49fa-8fff-9a8187d70b5a tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 204 len: 0 microversion: 2.1 time: 0.125599 May 11 10:07:43.466706 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 511/1011] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:07:43 2022] DELETE /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:07:43.475763 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:43.476885 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:43.483372 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:43.484112 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:43.485065 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:43.485683 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:43.761551 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:43.769029 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-13a6ef2e-4018-4592-b661-93ac7874acd1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1577 microversion: 2.1 time: 0.297908 May 11 10:07:43.769680 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 501/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:43 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1577 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 11 10:07:44.786842 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:44.787820 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:44.794129 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:44.794577 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:44.795346 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:44.795810 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:45.091570 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:45.099602 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-85d50b71-6053-49ed-b8a2-fd9008a0d4f7 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1577 microversion: 2.1 time: 0.316831 May 11 10:07:45.100284 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 512/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:44 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1577 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:07:45.494322 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-b83ff3d9-0d76-470b-9e8e-5c368585da50 req-ef3f89fe-dc60-4e64-ad1f-a0f5611b7ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b495ebf9-73ef-4bd4-9bad-040fa3dccfda", "name": "network-vif-deleted", "tag": "2fc915fb-d1a7-4ed5-b086-e945a5d437e5"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:07:45.502749 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b83ff3d9-0d76-470b-9e8e-5c368585da50 req-ef3f89fe-dc60-4e64-ad1f-a0f5611b7ef5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:45.503199 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-b83ff3d9-0d76-470b-9e8e-5c368585da50 req-ef3f89fe-dc60-4e64-ad1f-a0f5611b7ef5 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:45.514620 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-b83ff3d9-0d76-470b-9e8e-5c368585da50 req-ef3f89fe-dc60-4e64-ad1f-a0f5611b7ef5 service nova] Creating event network-vif-deleted:2fc915fb-d1a7-4ed5-b086-e945a5d437e5 for instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda on hv-cinder-83699 May 11 10:07:45.519931 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-b83ff3d9-0d76-470b-9e8e-5c368585da50 req-ef3f89fe-dc60-4e64-ad1f-a0f5611b7ef5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029758 May 11 10:07:45.520525 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 502/1014] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:07:46.117033 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:46.117685 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:46.123754 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:46.124227 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:46.125001 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:46.125433 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:46.155946 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:46.156387 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:46.156832 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lazy-loading 'fault' on Instance uuid b495ebf9-73ef-4bd4-9bad-040fa3dccfda {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:07:46.199477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:46.206115 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f252c109-2ef7-4b66-8811-ac1a92e9e5be tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 200 len: 1184 microversion: 2.1 time: 0.092924 May 11 10:07:46.206674 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 513/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:46 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 1184 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:07:47.225506 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:47.226228 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: b495ebf9-73ef-4bd4-9bad-040fa3dccfda] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:47.232296 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:47.232735 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:47.233512 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:47.233937 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:47.248366 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] HTTP exception thrown: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Request method failure captured: May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda HTTP/1.1 May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4lqpmhJPVd4p4SZd-wOyVUvEndG3Sf6BGnsfG6x3BTS7JUkNwrTDepiBtxHe8PLLhDZlL40cRJjot1j78xL1EqOjYdebqr3sXc8Q4IN5HqOwyDYCrCFHCjcTzrHwEzH-XHetlw1Zbo1-7wiT7lrJRbV2feTWiz4c6k2zwlU-1m-oAs May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:07:47.249938 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a4fff07e7c4d406bab0ec2d4ac48eaca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-TestVolumeBootPattern-616602638 May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: e457b7d59444405c89fb15e989245889 May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. May 11 10:07:47.251587 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'b495ebf9-73ef-4bd4-9bad-040fa3dccfda'} May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:07:47.252558 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. May 11 10:07:47.254175 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:47.255548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Returning 404 to user: Instance b495ebf9-73ef-4bd4-9bad-040fa3dccfda could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:07:47.255548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-115c6898-0169-430f-a60f-ffedad3db4e4 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda" status: 404 len: 111 microversion: 2.1 time: 0.030493 May 11 10:07:47.255548 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 503/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:47 2022] GET /compute/v2.1/servers/b495ebf9-73ef-4bd4-9bad-040fa3dccfda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:07:50.583504 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:50.584043 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:50.592223 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:50.592672 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:50.593436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:50.594049 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:50.621674 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Going to try to terminate instance {{(pid=123392) delete /opt/stack/nova/nova/compute/api.py:2664}} May 11 10:07:50.645275 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-01b9b84c-4455-4394-9061-0dd7e3cd9252 req-8a974cd7-c089-47b3-a43a-487041101d49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc042a1a-50b5-487f-af7a-4892334ae98d", "tag": "f1ca2d13-b602-47e9-b62d-87593dae121c"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:07:50.655015 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-01b9b84c-4455-4394-9061-0dd7e3cd9252 req-8a974cd7-c089-47b3-a43a-487041101d49 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:50.655457 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-01b9b84c-4455-4394-9061-0dd7e3cd9252 req-8a974cd7-c089-47b3-a43a-487041101d49 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:50.668278 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-01b9b84c-4455-4394-9061-0dd7e3cd9252 req-8a974cd7-c089-47b3-a43a-487041101d49 service nova] Creating event network-changed:f1ca2d13-b602-47e9-b62d-87593dae121c for instance cc042a1a-50b5-487f-af7a-4892334ae98d on hv-cinder-83699 May 11 10:07:50.673895 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-01b9b84c-4455-4394-9061-0dd7e3cd9252 req-8a974cd7-c089-47b3-a43a-487041101d49 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091801 May 11 10:07:50.674496 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 504/1017] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:07:50.710254 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-90490c1c-87bb-4307-9b7f-802fe08c4c6e tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "DELETE /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 204 len: 0 microversion: 2.1 time: 0.130358 May 11 10:07:50.714711 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 514/1018] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:07:50 2022] DELETE /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 11 10:07:50.720686 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:50.721768 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:50.728550 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:50.729222 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:50.730168 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:50.730718 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:50.865902 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.policy [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123393) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:50.873423 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d5de22e2-4a3d-4dfd-955e-fdba5486f1e3 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1576 microversion: 2.1 time: 0.157084 May 11 10:07:50.873987 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 505/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:50 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:07:51.892066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:51.893965 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:51.900797 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:51.902842 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:51.903554 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:51.904653 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:52.059066 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:52.066478 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-73f47846-c159-43bc-bcfb-af10f0cdb5ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1576 microversion: 2.1 time: 0.179874 May 11 10:07:52.067041 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 515/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:51 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:07:52.725243 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [req-f9a6bb16-7c85-49df-bc36-2fa0e68e0357 req-b1ff2382-4257-4b87-87c9-58c1ffe2fab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc042a1a-50b5-487f-af7a-4892334ae98d", "name": "network-vif-deleted", "tag": "f1ca2d13-b602-47e9-b62d-87593dae121c"}]} {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 11 10:07:52.733427 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-f9a6bb16-7c85-49df-bc36-2fa0e68e0357 req-b1ff2382-4257-4b87-87c9-58c1ffe2fab4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:52.733871 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [req-f9a6bb16-7c85-49df-bc36-2fa0e68e0357 req-b1ff2382-4257-4b87-87c9-58c1ffe2fab4 service nova] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:52.746207 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.compute.server_external_events [req-f9a6bb16-7c85-49df-bc36-2fa0e68e0357 req-b1ff2382-4257-4b87-87c9-58c1ffe2fab4 service nova] Creating event network-vif-deleted:f1ca2d13-b602-47e9-b62d-87593dae121c for instance cc042a1a-50b5-487f-af7a-4892334ae98d on hv-cinder-83699 May 11 10:07:52.751479 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [req-f9a6bb16-7c85-49df-bc36-2fa0e68e0357 req-b1ff2382-4257-4b87-87c9-58c1ffe2fab4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030114 May 11 10:07:52.752113 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 506/1021] 10.222.0.44 () {64 vars in 1317 bytes} [Wed May 11 10:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 11 10:07:53.083477 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:53.084252 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:53.090860 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:53.091404 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:53.092294 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:53.092799 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:53.125586 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:53.126036 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:53.126497 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.objects.instance [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lazy-loading 'fault' on Instance uuid cc042a1a-50b5-487f-af7a-4892334ae98d {{(pid=123392) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 11 10:07:53.166122 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.policy [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e457b7d59444405c89fb15e989245889', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fff07e7c4d406bab0ec2d4ac48eaca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123392) authorize /opt/stack/nova/nova/policy.py:199}} May 11 10:07:53.173912 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-b2ea785d-9b5d-4271-95f4-54f8ac6c1b5c tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 200 len: 1230 microversion: 2.1 time: 0.094407 May 11 10:07:53.174472 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 516/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:53 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 11 10:07:54.191760 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:54.192460 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: cc042a1a-50b5-487f-af7a-4892334ae98d] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:54.198583 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.199030 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.200454 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.200893 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.214142 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] HTTP exception thrown: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Request method failure captured: May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d HTTP/1.1 May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4lqpmhJPVd4p4SZd-wOyVUvEndG3Sf6BGnsfG6x3BTS7JUkNwrTDepiBtxHe8PLLhDZlL40cRJjot1j78xL1EqOjYdebqr3sXc8Q4IN5HqOwyDYCrCFHCjcTzrHwEzH-XHetlw1Zbo1-7wiT7lrJRbV2feTWiz4c6k2zwlU-1m-oAs May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:07:54.215832 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a4fff07e7c4d406bab0ec2d4ac48eaca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: e457b7d59444405c89fb15e989245889 May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. May 11 10:07:54.217495 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': 'cc042a1a-50b5-487f-af7a-4892334ae98d'} May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:07:54.218988 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. May 11 10:07:54.220616 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.221982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Returning 404 to user: Instance cc042a1a-50b5-487f-af7a-4892334ae98d could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:07:54.221982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-d4b59de2-0d5b-4b13-93b5-95ce7a442aa2 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d" status: 404 len: 111 microversion: 2.1 time: 0.030176 May 11 10:07:54.221982 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 507/1023] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:54 2022] GET /compute/v2.1/servers/cc042a1a-50b5-487f-af7a-4892334ae98d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:07:54.644949 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:54.645505 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.compute.api [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123392) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:54.651774 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.652224 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.653036 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.653471 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG oslo_concurrency.lockutils [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123392) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.666530 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.wsgi [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] HTTP exception thrown: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Request method failure captured: May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: request: DELETE /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 HTTP/1.1 May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept: application/json May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Accept-Encoding: identity May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Connection: close May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Length: 0 May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Content-Type: application/json May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Host: 10.222.0.44 May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Openstack-System-Scope: None May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: User-Agent: python-urllib3/1.26.9 May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Auth-Token: gAAAAABie4lqpmhJPVd4p4SZd-wOyVUvEndG3Sf6BGnsfG6x3BTS7JUkNwrTDepiBtxHe8PLLhDZlL40cRJjot1j78xL1EqOjYdebqr3sXc8Q4IN5HqOwyDYCrCFHCjcTzrHwEzH-XHetlw1Zbo1-7wiT7lrJRbV2feTWiz4c6k2zwlU-1m-oAs May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Id: None May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Domain-Name: None May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Identity-Status: Confirmed May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Is-Admin-Project: True May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Id: default May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Domain-Name: Default May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Project-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Role: reader,member May 11 10:07:54.668720 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Roles: reader,member May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a4fff07e7c4d406bab0ec2d4ac48eaca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-Tenant-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Id: default May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Domain-Name: Default May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Id: e457b7d59444405c89fb15e989245889 May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: X-User-Name: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: method: > May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: exception: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.670344 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: action_args: {'id': '7b23ffe8-185c-40fa-a29e-ddca19f85158'} May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:07:54.671436 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.673055 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: ERROR nova.api.openstack.wsgi May 11 10:07:54.674759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Returning 404 to user: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. {{(pid=123392) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:07:54.674759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-f3b5ea6c-e8d6-482c-8aba-f0af126c08e1 tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 404 len: 111 microversion: 2.1 time: 0.029206 May 11 10:07:54.674759 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 517/1024] 10.222.0.44 () {58 vars in 1238 bytes} [Wed May 11 10:07:54 2022] DELETE /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:07:54.678645 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '>' {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:54.679312 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.compute.api [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] [instance: 7b23ffe8-185c-40fa-a29e-ddca19f85158] Fetching instance by UUID {{(pid=123393) get /opt/stack/nova/nova/compute/api.py:2920}} May 11 10:07:54.685800 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.686245 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.686998 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 11 10:07:54.687428 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG oslo_concurrency.lockutils [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Lock "463f4e36-bb1e-4421-b4b9-54d886540532" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123393) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 11 10:07:54.700207 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.wsgi [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] HTTP exception thrown: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Request method failure captured: May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: request: GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 HTTP/1.1 May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept: application/json May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Accept-Encoding: identity May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Connection: close May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Length: 0 May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Content-Type: application/json May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Host: 10.222.0.44 May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Openstack-System-Scope: None May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: User-Agent: python-urllib3/1.26.9 May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Auth-Token: gAAAAABie4lqpmhJPVd4p4SZd-wOyVUvEndG3Sf6BGnsfG6x3BTS7JUkNwrTDepiBtxHe8PLLhDZlL40cRJjot1j78xL1EqOjYdebqr3sXc8Q4IN5HqOwyDYCrCFHCjcTzrHwEzH-XHetlw1Zbo1-7wiT7lrJRbV2feTWiz4c6k2zwlU-1m-oAs May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Id: None May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Domain-Name: None May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Identity-Status: Confirmed May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Is-Admin-Project: True May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Id: default May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Domain-Name: Default May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Project-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Role: reader,member May 11 10:07:54.701685 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Roles: reader,member May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a4fff07e7c4d406bab0ec2d4ac48eaca", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a4fff07e7c4d406bab0ec2d4ac48eaca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}] May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Id: a4fff07e7c4d406bab0ec2d4ac48eaca May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-Tenant-Name: tempest-TestVolumeBootPattern-616602638 May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Id: default May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Domain-Name: Default May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Id: e457b7d59444405c89fb15e989245889 May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: X-User-Name: tempest-TestVolumeBootPattern-616602638-project May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: method: > May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: exception: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.703357 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: action_args: {'id': '7b23ffe8-185c-40fa-a29e-ddca19f85158'} May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: {{(pid=123393) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 11 10:07:54.704362 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. May 11 10:07:54.705870 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: ERROR nova.api.openstack.wsgi May 11 10:07:54.707239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: DEBUG nova.api.openstack.wsgi [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Returning 404 to user: Instance 7b23ffe8-185c-40fa-a29e-ddca19f85158 could not be found. {{(pid=123393) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 11 10:07:54.707239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO nova.api.openstack.requestlog [None req-8d006b76-e0f2-4b01-805b-63a561b084ce tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158" status: 404 len: 111 microversion: 2.1 time: 0.028175 May 11 10:07:54.707239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: [pid: 123393|app: 0|req: 508/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Wed May 11 10:07:54 2022] GET /compute/v2.1/servers/7b23ffe8-185c-40fa-a29e-ddca19f85158 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 11 10:07:55.987582 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: DEBUG nova.api.openstack.wsgi [None req-502225e4-b8ed-4567-aad2-56e1f3d2c28f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] Calling method '.version_select at 0x7f8bcd37faf0>' {{(pid=123392) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 11 10:07:56.010269 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO nova.api.openstack.requestlog [None req-502225e4-b8ed-4567-aad2-56e1f3d2c28f tempest-TestVolumeBootPattern-616602638 tempest-TestVolumeBootPattern-616602638-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1603837308" status: 202 len: 0 microversion: 2.1 time: 0.026456 May 11 10:07:56.010891 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: [pid: 123392|app: 0|req: 518/1026] 10.222.0.44 () {58 vars in 1262 bytes} [Wed May 11 10:07:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1603837308 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 11 10:08:03.301673 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:08:03.302323 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:08:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:09:52.895493 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:09:52.896239 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:10:14.874909 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:10:14.875622 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:10:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:10:25.652118 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:10:25.652673 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Wed May 11 10:10:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:11:23.310384 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:11:23.310900 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:11:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:11:49.017376 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:11:49.017979 dv-cinder-836996-21-iscsi devstack@n-api.service[123392]: Wed May 11 10:11:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 11 10:13:12.903516 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 11 10:13:12.904166 dv-cinder-836996-21-iscsi devstack@n-api.service[123393]: Wed May 11 10:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!